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tBSTRACT 

The evaluation data fb? this report on the Elesentary 
Secondary Education Act Tlt]?e IV ^rograas In New ^^sey Include 
publljshed material, ^fugitive** docibaents fron the iTles of Nev Jersey 
Oepartaent of Education staff,. statistic^ Information coaplled 
especially for this study, nuserous Intetwlevs with aeabers of the 
Oepartaent and visits to 38 local districts. Tltl^ IV provides fundi; 
to purchase school library or other Instructional resouirces; develop, 
field test, and dissealnatd Innovative prbgraps; and assist the state^ 
to Identify and aeet educ^atlonal needs. Three basic questions were: 
(1) To what extent did the state adhere to the aultiple elements of 
each prograa, as se^ forth in the 1976 Aiinual Progr^a Plan?; (2^ In 
-what respects did the procedures used support or hinder efficiency in 
prograa/adainistrat^ion and achleveaent of program objectives?; and 
(3) To what extent have program objectives for each part of Title IV 
actually biaen achieved? In nearly every Instance, the adijinistrative' 
procedures and activities jset fo^th in New Jersey's Annual Prbgran . 
Plan were carried but in an-exemplary fashion, as tl^ey had been in 
the 1976 fiscal year program. (Authot/CTM) 
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EXECUTIVE SUMMARY a'nD RECOMMENDATIONS 



INTRODUCTION 

-The Title *IV. Program in New Jersey is comprised of three program, elements, 

The programs provide funds to: 

^ .0 Purchase school Ijbr^iry or other instructional resources; 

for minor remodeling of publ icly G^^pcd classroom spa.ce; . . 

_.'.or for progi^ams of guidance, coi;^^ ' ^ and testing. 
During FY 1977, $4,589,353 was .a ■ ^-d to 570 local 
school districts in New Jersey. Seven hundred forty-two 
non-public schooVe also participated in the Program. , ^ 

0 Develop, field test, and disseminate innovative programs 
to meet documented educational needs as contrasted with 
-services to speciTic student populations^ During FY 1977, 
$2,273,p58 was awarded to loca] school districts in New ^ 
Jersey. 1 ^ ' ^ ' \ 

0 Assist the State Education. Agency in establishing and 
. : imprpving programs to identify and meet educational needs 
at the State and local levels. During FY 1977, $1,696,829 
^ V was spent , on "strengthening SEA" j^ictivi ties in New Jersey. 

During FY 1976, New Jersey' administered the Titla IV Program as welll . . 

as the individual categorical programs it now replaces. During FY 1977\i 



through reorganization and cohs:o1idat1on, 'the Department has administered , 
the Prbgram through the Office of tt)e Deputy Commissicfrrer. Responsibilities 
ifi.c program activit.ies are delegated to appropriate Department 



foV specii 
staff. A 



State Title IV Director administers the Annual Program Plan and 

coordinates all Title IV administrative activities. 

The State Title IV Advisory Council is required to evaluate a I'l pro- 
" * ...... '■ ' . 

gr\ams and projects assisted under the Title. Title 45, Code of Federal 

Regulations, Part 134.16 states: • \ ' 



1 



The evaluation data for the report s^nclude published material and • 



The annual program plan^shalT provide for . . . an evalua- . 
* tion by the State Advisory Cpuncil atJeast annually, of 
the effectiveness of the programs and projects assisted 
under the annUal prbgram plan . . .• _ 

THs regulation provides .the authority for the present evaluation of the 

ESE^/Title IV Program in New Jersey. . . 

This evaluation builds on- that conducted for the FY 1976 Prpgram. 

The methodologies employed in that evaluation have been continued this 

year with some changes to improve data col lection procedure.s. . 

' a 1 ajd 

reports, "fugitive" documents from files of Department staff, statistical 
information compiled especial ly for this study^ numerous interviews v^h 
members of the Department, and for Part IV-B, thirty-eight on-site local 
district evaluation visits.. • ' 

The report of . evaluation addressed, three basic' questions : 

• ' To what extent ^3id the state adhere to the multiple elements^ 

of each program, as set forth in the Annual Program Plan, 
submitted in 1976 to the U.S. Office of Education? 

• In what respects did the procedures used support or hinder - 
efficiency in program administration and achievement , of \ 
prd'gram objectives? 



i, • . To what^xtent have program objeetives for each part of 
,\ Title IV actually bfien achieved? 



: EV/^LUATION FINDINGS ' 

Adherence to the Plan ^ 

In nearly ever^y instance, the adrrtinistrative procedures arid activities 
set forth in New Jersey's* Annual Progr^am Plan were carried out in an ' 
exemplary fashion. This perforinajice continues that realized in the' conduct 
of the FY 197;6 Program. 

» ■ . • . ■ . . 

WithYespett to TitTe IV-B, all process requirements were followed; • 
/Jhese included using approprtatp financial information and preparin^g 
, formulas for 'the distribution of funds; preparing a single application; 
providing- instructions, technical assistance, and tn-^ervice training; ' / 

. ' ■ 1,. >■ ; < . - • , ■ , 

monitoring and evaluating; and assuring maintenance of effort and non- 

) public school participation- ' * ^ 

■ : . ' With one exception; the IV-C, Edtig^tio^n Innovation Rr^ 

all of 'the atove process requirements ^and ^T§o complied with those relating 

to" evaluation, ya^lidatibn, and disseminat-ion. \ The one-exception to compIjAnce 

^ ^ ^ith IV-C process requ.ir^nfents specif ied iTi the Annual .Prograin. PI an .^^ds wi^th 

respect to- non-public sghool participa^tioh. - Nearly half -of the JV-C pro- 

' > * . . .. ■ . : ■ - : - ■ ' ' ' . . ' ; 

posals^kubm'itted failed to provide documentation of .^ef^^^ to include 

' fion-public *scJiools Jin the planning of the proposal . - The'^Statfe ms in 

compliance with the Ji tie IV Tegislatira in^ thart all funded projects flocu- 

-mented ai^propriate non-public school involvement., ^ , . . ^ 

\ ' ■ ' . ' ■* V'' , ^ ' " '■ ^ • , - ^' . ^ /-'-^ ^ . 

V^- AM of • the objectives an^'acti viti'^s proa-jBCted in the. Annual /Prdgraifi 
"Plan for' "Strengthening the\ SEA'\ werfe' address^fed by the Department during 



3\ • . 

■ ; '^^ V. 
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FY 1977. In a few instances, activities were conducted which exceeded the 
minimum requirements of the Plan-., Major activities undertaken were: 1) the 
implementation of th,e Operational Planning System; 2) the implementation , 
of the intermediate unit structure; 3) dissemination of, iriformation on T&E 
' through Interact, the Department newspaper; andi 4) an -increasedl' service 

^ . m ' ^ ^ 

capacity for supporting LEA T&E'^efforts. • / .} ^ " 



Assessment of the Process ' . • 

Beyond the fulfiHitient of the requirements of the Plan, several 

activfties undertaken: by the Department found to be particularly - 

effective. For IV-B, these' ^re: 

1) Part B Allocation Formula^ . This complex set of foNulas 
appears to respond to the letter and the kpirit qf the 
legislation, The,formul^ have been cited by the U.S,.. 
Office of Education and aooptded or adapted by other States. » 

- . . ■ 'X ' 

. 2 ) Efforts to Involve School Di^^icts .' The Department was 



able to provide funds to; 570 
^ an increase of thirty-five o\?er 



tion opportunity was extended to. a 



lool districts during FY 1977; 
FY 1976. A second applica- - 
11 districts which did * 



not apply originally and seven 



istricts were funded. 



. 3) • Non-PublTC School Invol vemertt - ' Ninety-seven percent of all 
eligible diitfTcYs parti ci pa ted/in TitlV IV-B in f|L 1977 
e an^ '94 percent of all noa-p^lbprfc scliools also partTtipated., 
,ThQ Department took spjecial steps to extend title IV-B , ' 
dollars to all, eligible districts and schools. 

4) Technical Assistance . - Documenta-tion and interviews indicated 
that the Department provided assistance to all local districts 
requesting help. The services of the Departrrient Were.^r^^ 
- as excellent by the majority of l*oc'al adrfiinistrators. 

Some Part C administrative procedures also were found' to be of high. 

quality. These are: 

1) Reorganization of IV-C Program . - The reorganization of the ^ 
IV-C Program coordinated IV-C actiyiti'es with those similar 
activities/ in. the Department. The impact^of IV-C will be ' ^ 
. enhanced and made more visible'as a result of its integration^ 
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. ■ : " . ^ r s- ■ 

with T&E ^''thorough an?! efficient), the educational 
planning -system rnan^rated;::^r all school districts in 
. ' New Jersey. * " ♦ V 

Review of IV-:C Pro^josals , While not required, the Depart- 
»i , ment continued its practice. of using outside readers for . 
proposals in order to assure a high quality review. State 
i ^Advisory Countil members also took an active role in the 

. I review process. . 

'3) Technical Assistance . Continuing a practice \egun in 

' FY 1977, the Title JV-C staff extended assistance tp aCLU 
' ^ di^trictsM'ti reviewing drafts of proposals prior to ^ub- s 

mission. It is likely that as'sistance from the staff 
_ was instrumental in" increasing the number of applications 
by 'nearly 70 percent over FY. 1976. 

The activ'it-jes and services developed and implemented' in the conduct 

of ^he Strea^thening SEAs Program were found to be of high quality. The 

development and impl'^mentation of a, T&E educational system served as a 

reference point for all of the six objectives established ;in the Annual 

Progratii Plan. : ./ 

/ . . . 

Certain proce/ses implemented in the conduct of the Program during- 

FY 1977 could be strengthened in future years. Problems With respect to 

these processes are as follows: ^ ^ ' 

^ ' 1) There does not appear to be an adequate process for 
■ ensuring that each IV-C application contains ,the 

required documentation regarding efforts to involve 
' non-public ^schools. ' 

2) With respect to IV-C, data and data collection require- 
, ' ments have changed in some cases between FY 1976 and 
FY 1977,' making it difficult to buildva longitudinal 
" data base/for the Program. ' . ' 

. ' • t' ■ ' ■ 

Assessment of Outcomes^ and Impact 

Outcomes and impact for the three component parts of Title IV .must 
be judged at different levels. While it is possible to identify outcomes 
for each of the three components , it is mu^ more difficult to assess the 
impact of the activities and services or/ student performance or other 
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individual or organizational changes, particularly with respect to Part' B ' 

.an,d Strengthening SEA, For example, it is poss.ible' to identify the outcomes 

' ' ■' • ' ' • * ^ ■- ' • ^ , ■ 

of IV-B/expendi tures in terms of library, 'materials ^and equipment purchased. 
It is much more difficult to assess th'e impsfct of the materials and equip- 
ment on student /eartiing. This Matter form of assessment has yet to be 
addressed, in part because local school distriGts^are not r'equired to 
evaluate their^ IV^B projects. 

■ ' ■ /• . 

In tems^of Tit]e IV-B outcomes, the on-site evaluat^'on stuyies indicate ' 

» . •. > 

that the funds. Are spent to purchase needed materials in support of an on-going 

or new prpject or program. Districts Infrequently use the funds for testing, 

counseling, an^l guidance programs. The expenditures by category for non-public 

schools nearlj^ para^llel those of t^e public schools. . . 

\ As evidenced by the on-site evaluation studies, local discretion has ^ 

not resulted in frivolous^ allocation of funds, although it appears to be 

• ^ , ■ / ^ .... ■ . ' 

the case that the targeting of the lirmted funds to a particular school or 

program demonstrates more measurable impact. Meaningful, integration with 

the local T&E process also appears to enhance impact. Finally, maintenance 

of effort for state and local districts does not appea^; to be impeded. • 

» , ■ . • 

During FY 1976 and 1977, New Jersey has been able to exceed maintenance of 

effort requirements. ^ . / 

l^ith respect to Title IV-C, both outcome and impact assessment are 

built-in 'requirements of eachproject, thu3 facilitating a determination 

of total Program ^impact. Objectives for. each project are written in terms 

of spec.ific itnprovements in student learning or teacher behavior. The . 

large number of projects validated nationally or within New Jersey attest 

td the' impact. of tjie projects. . ' 



: Qf nineteen projects d-^seminated by the $tate in FY 1977, eighty- ' 
eigM^New' Jersey districts-and 129 owt-of-state districts adopted them. , 
^ Nearly -tomplete information shows that cipproximately 252,344 NewVJersey 
^tudents and 6,935 teachers in New Jeil-sey (duplicated counts) were, af fee t'fed 
by them. Counti^n^reviDUs years, a total of 483 adoptions had taken plac^ 
in New Jersey. >A1so,. over the five years (1972-76) for which data' were 
available, eighty-two projects completed development* and, Iseventy-nin'e ^con- 
timed with' local funding. ,^ , • ' •" ' < ' ■ 
I For the Strengthening the SEA, Program, while outcome indicators are 
in nhore 'plentiful ayinny than in FY 1976, impact data still are cj^if'ficult 
jto (j)Ktain.....;Bp;th actiyitiss and the jjroducts of this Program are, of good 
quaj/fty and reflect the 'best of theory and practice but it is difficult 'tb 
-judde Impact. ' ' ■ " . ' ' 

"The intermediate unit structure which was implemented fu^tl^ in FY 1977 
is providing an extensive amount of quality services to local school dis- 
trijcts and feedback from LEA personnel is positive. The impl ^mentatit)n of 
a ijormal evaluation of ETC services- in FY 1978 will provide more,. rel i able 
and Viilid impact data. 

Considerable progress was made in the design and implementation of the 
Opteraticr'nal Planning System duri ng FY 1976. the inclusion of the Coufity 
• Ofjf ices j and the EICs -in the process will make it possible to tie the " 
Department and the intermediate units together mdre closely in terms of 
T&E rel^^d objectives and the delivery' of appropriate services. - > a 

Interact continues to disseminate timely and. high-quality articles' 
■ ■ "1 v ■ ' " ' ■> ^ ' . ' 

on T&Elactivities, Durirfg FY 1977, every issue contained at least ohe 




article addressed to T&E and one entire\i$sue was devoted to the process. 
Limited, use of other channels of Qonimuntration regarding T&E were Silso uked. 

.RECOMMENDATIONS . ' . ^ , * 



L J 



The overall conduct of the Titl^ IV Program in New Jersey is crfaracter 



ized by high quality activities and outcomes. Where impact data are avail- 
able, they indicate thatsuch activities are' having a positive influence 

" -- - ^ J- : ' ^ . . ■■ , 

on student learning and on the'overall educational program in locarl schciol 



■I 



districts. 



mn 



I 



/ The fol lowi ng' recommendations'. are based 'on ah intensive review of 
the Title ^IV process as it is carried out in New Jersey and of its outcomes. 
The recommeiodations are offered in the spiritSf sirengtheming New Jersey's 
already highly productive Title IV Program. 



Management 



Part B 



2) 



Consider the deVfelopmeVit of a formal assessment of the 
management of Tit]e IV. ^Such an evaluation shoyld 
address at ii •minimum the followirfa elements^: planning, 
''quality control procedures, communication, personnel * 
management, State Advisory Council involveihent-, monitor- 
ing and evaluation procedures , aad dis'semi nation. 'Such 
an assessment might emphasize .a particular management 
process from year to year, depending on available^ - 
resources^. -If such is the , case, it is suggested that ' 
the;^ dissemination function in the Title IV Program be 
g*yen consideration for early review since it^ appears 
to be.a critical element in all three program areas. 



Formalize the selection of Title IV -.B exemplary projects 
using*the entire' population of projects from which the 
selection is made. Self-nomination may be an appropriate^ 
way to narrow the field.. Adapting some of the procedures 
used for reviewing Title IV-C projects may be. a. means of 
transferring some of the clarity and actountabflity;, of the 
Title IV-C process to the best IV-B projects; ^' 
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3) Broaden the d i s semi nation .«ef font for Part B exemplary ' « 
projects. Con§ider usiji'g^ publications an(l presentation^ 

^.at orientation , sessions and workshops in' addition to the ' 
awards pi:esent;fltion at the.EHucation^y Development Confer- 
ence. Disseminate' information, about projects^hat focus^ 
IV-B monies on special projf^cts or target populations , or 
vthi^ ace integrated with the LEA j|)E process. 

4) / Provide LEAs with a wide range of sahipTe objectives which 

are meaningful and useful. Suggest ways" in vyhich si,mp1e 
assessment techniques can be. used to ascertain whether ' 
<'the nfiohey is'being well spent. It is possible that'; 
appropriate evaluation procedures might be developed' 
' during f^Y 1978 and us^ by thos? districts fishing to 
be; considered as exemplary; At the State level, consider 
the use of a seTec.t. number of carefully developed case . 
studies to vllus-tra^e -the variety of "exemplary uses to ; 
which IV-B funds can be^dir'ected. 



5) Improve^ and standardize where possible the data require- 
ments and the data collection formats developed during 

- FY 1976 and 1977. Changes should be ma'de Only where 
benefits in information utility will be -increased sub- 
stantially, ^y^T^ddi^t data requirements ^and formats 
should be.aflded to the' basic design ^as n6w information " 
needs are identified. - ^ 

■■ ^ ; ■. . ' ^. ' ■ ■ ■■■ . \. 

6) Establish a review procedure whicli' checks afl subil^ftted 
applications for complflance with requirements regarding 
non'^Pl/blic 'scho>l particip^itipn in planning^ and implem^nta 
tion of IV-C projects. An inexpensive clerl'cal tj-eview* 
process would provide s^uff^icient review.*''^ - ' 

7) ' Continue to tracl^ progress of.eofisumer districts in ' 

achieving statistically significant gains for IV-C proj- 
ects to match those of producer districts in adopting 
the new program in the new setiring. Studies of the change 
process indicate that the^ process of implementation of an^ 
innt)vation. involves a .cbmpleX: set of cha*nges over a long 
period pl^time. the lack ^of' extensive study in'th1.s ar'ea 
could provide an opportunity for the New Jersey Department 
•of Education to extend its leadership -i n the area t)f > 
innovation. * .v - . n 

8) : This same areavbf cha'nge ' (impl ementatioh) could also be 

addressed; through continued- pursuit of a joint develops 
ment process among seVeral districts-. The "lighthouse" 
concept of innovation is only one alternative , for facili- 
' tating improvement irt educational programs and practices. 
This area,, also, is one in which the experience of 
Depjartment ;staff might be put to use in designing, new v J ' 
directions 'in development. ^ 
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strengthening the SEA^ • ' 

9) Measuring .the outcomes and impact of Strengthening SEA 
.activities is impeded by the lack of measurable and 
proximate indicators of achievement. Many of the 
activities in the Annual Program Plan are stated in 
global and vague language. Specifications in opera- 
tional ierms are seldom available. ^ Such specif icat^'ons 
- would facil itate- the development of formative and summar 
^ Jtive evaluation designs which, when implemented, could 

become part of the on-going admfni stration of the activity.^ 

10) As in FY 1976, the Department relied heavily on Interact 
for its communications regarding T&E. While Interact is 
a high quality, one-way 'communications mechanism^' formal 

• feedback mechanisms should be employed. The Departmenj; 
should consider the use of multiple methods fdr ascer- 
taining reader response to the paper, particularly to' 
P those articles dealing with T&E.^ /'Town Meeting 11" 

represents an excellent model for moving in that direc- 
tion. 

11) An effort should be made to clarify the roTes'and 
responsibilities of the EICs vis-a-vis the County Offices. 
Available ^descriptive material does not accomplish this. 
Also, some attention should be given' to helping the EICs 
establish a clear mission statement which addresses such ^ 
issues as their relationships with the Department and with ^ 
the LEAs and the degree to which they are to offer similar 
services as opposed to "unique" services addressed to regional 
needs. The EICs represent a major organizatidjpal innovation, 

thus requiring clarity . of purpose and role' for effective 'j 
implementation. •/ 

12) Because T&E is a major innovation which i^ receiving much 
national attention and because Title IV, particularly the 
Strengthening SEAs Program, is so integrated with it, the 
Department should^consider the development of a broad 
case study of the design and implementation process. This 

^ information would bo most useful as a— summary of the speci- 
fic information being collected in the State and would 
provide a valuable service to other SEAs engaged in similar 
activities. The T&E effort in New Jersey has several 
features which are exemplary and worthy of dissemination 
nationally. 

y • . 
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■ ; INTRODUCTi^efN . - ■■ ■ 

a;. BACKGROUNDOFTITLE.lv i 

^ With' few exceptions, categorical programs have been lauded by Congress 
and berated by the state and local^ governments that serve as administrative 
agents, for them. Ttie appeal of such programs to Congress is that t^ey.make 
it possible to target monies to specif ic [needs or populations, bane of 

such programs to state and local governments is that they reduce opportuni- 
^ties for adjusting to local rie^ds and create inefficiency and waste in their 
administration. 

ESEA, Title IV, the first major consolidation of federal education" 
funds, was viewed by members of Congress as a. compromise, simplifying |pro- 
gram, administration for both s'^tate a.nd local governments while retaining- 
• some of the categorical character of the previous programs. FY 1976 was 
considered a "phase- in^ year-, with 50 percent funding of Title IV and 
,50 percent funding of the old categorical programs. 

Although Title IV is funded as two block grants, Parts B'and'c, the 
Program Kas three major, somewhat disparate components. There is little 
that binds the three component programs together beyond the title, and 
State Education Agencies (SEAs) and local education agencies (lEAs) are 
hard-pressed -to put any two of them together for- a coherent fit. 

There are -some el ements of the. Program that enhance its utility to 
SEAs and LEAs (although sometimes not to both parties, depending on the 



element). Priorities, for fuh'dTng are left tb H^te and 1 opal judgment, 
Only a single appllid^on .from an (!EA^is allowed - the paperwork burden ort 



LEAs is thus reduced, jtrf-' 

Use of Part B funds wi thin >^aiuthori zed puifposes is determined exclusively 



at the locatl level, and priorities for Part C discretionary funds are set 
by the states. There are "ceilings on funds for state program admi^nts^ration. 
in both' Parts B and C, and on use of ^f unds for ESEk Title' V type activities 
(strengthening state Sind local education agencies) in Part C. There is 
alsQ^a set-aside to support programs for the handicapped in P^rt Q',- Equit- 
able parti ci pa tio^n of children in private, nonT^roWt schools must be pro- 
vided in all local programs and- projects. The law alsq provides guide-lines 
on distribution of funds by the states to theJocaT education agenqies:- 

jPart B — A maximum of 5 percent (or $225,000, whichever is • 
greater) of the funds may be used for state administration, 
and the remaining 95 percent of the funds must be distributed 
to LEAs according to. enrollment (public and private, non- 
profit), special fiscal effort, and numbers of high-cost 
children. , , 

i Part C After the maximum set-aside for strengthening state 
and local education agencies (15 percent or the amount received 
in FY 1973, whicheveV^^ is greater) and for state administration 
(5 percent of the remainder, or $225*,000, whichever is greater) 
project grants are made for local projects on the basis of 
state-determined priorities on an "equitable basis'! recognizing 
the competitive nature of the grantmaking. States are, however, 
required to provide assistance in formulating proposals an3 in 
operating programs to LEAs which are less able to compete due ,to 
small si.ze or lack of local financial resources. .Fifteen per- 
cent of the funds (after tKe set-aside for strengthening state 
and local education agencies) must be used for programs and 
projects for the education of children with* specific learning • 
disabilities and handicapped children. 

Since the initiation of the programs included in the Title IV consolida- 
tion, some of which became* active in 1959, several billions of dollars have 
been provided by federal appropriations for the affected programs.. Current 
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appropriations, (FY, 1977) are $348 mvllion (Part B $154 million, Part'c 

$194 million). ' ' . 'v ; . . " . . " 

' Features of the Title IV consolidcftion of particular interest include; 

^ ^ L The first year of implementation (FY 1976) was on the 
basis of a 50-50, split between categorical and co'n- 
solidated admi ni\strati on: Rules , regulations, and 
requirements for the separate categorical prograins 
were in effect for half the funds.: ' 

2. States determine the priorities for use of Part funds, 
but are limited' by^requirpments or limitations on us^s 

^' ; of funds for st§te;administrat*ioni provision of services . 
for the handi'capped, and. activities' for strengthening 
state and local educatian agericies. 

;■■ ' I . : 

3. Requirements vfQr participation of private non-profiti 
/ schoqls arevmos't stringent than ^tfeyiously.. . Local ^-yc^ 

education agencies are charged^with use of Tund.s for \ 
the benefit of private non-profit schpol children in \ 
proportion to the percentage of publiq school/childnen 
r ' receiving benefits and in consideration of^-^tffejr 

\ - ^ special /needs. . . " 
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Local education agencies h^ve cqjnple^ discretion 
within allowable categories in det'erinAning priorities 
for use of Part B funds. 



/ 

5. , States are to provide special assistance in formulat- 

irig proposals and operating programs to small or poor 
..school districts less able to compete'in the Part C 
/• program. 

6. Part B funds are to be^ distributed by the states to 
^ LEAs on the .basis of school enrollment Cpublic and 

V ^ private), except "substantial fi^hds" are to go tO'- 

\ districts with high tax effort but lower thar\ aver'^ayge 

per pupil expenditure and those with the greatest 
numbers or percentage of high-cost pupils, such as 
cljiildren from low-income f^ilies, children living 
in sparsely populated areas, and children from fami- 
lies in which English is not the dominant language. 

7. A State Advisory Cpuncil is required in each state to 
advise on administration of the program, evaluate . 
programs and proj^pts, an^^prepare an annual report. 
SEAs are to provide ^eces^ary funds and resources. 
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. 8. A single appltcation is required from :loca1 education agencies 
' Vapplying for funds under any program under T.ltle IV. 

9. A^maintenance-of effort requirement, applicable to both' public 
i aind private school expenditures. " - 



3.. TITLE IV I,N;NEW JERSEY ^ ' ^ . ■ . ; ' , ' • 

' \- : ' • /'■; ' . . - <^ ' ' ' 

Du^ing FY i976, New Jersey administered the-Titi-e IV Program as well as 
the individual categorical programs it, now replaces. During FY 1977, through 
reqrganization and consolidation, the Department has a.dijiinisterecj the Pro-- . 
gram through the Office of the Deputy Commissioner. Respopsibili ties -for' 
spectfic program activities are delegated to appropriate] Department staff. 

' ' \ . r / . i^' /■ . ...^ ■ 

A'State Title IV^Director administers tlje Annual Program Plan arrd-xcoordirtat^s 

all Title IV aidministrati ve activities. ^' 

.l^e Title *IV Program in^New Jersey is comprised of ^hree procfram elements 

The programs provide funds- to: 

• Purchase school library or other instructional resources; for , 
^ minor remodeling of publicly owned classroom space; or for J 

programs of guidance, counseling and testing. During FY 1^77, 
$4,589,353' was allocat,ed to 570 local school districts . in 
Nevy Je^^ey. Seven hundred forty-two non-publ ic schools also 
participated in Jdne Program. - 



. • Develop, field test, and disseminate inn&Vative programs to 
meet documented educational needs as contrasted with^ services 
to specific student-populations. During FY 1977, $2,273,058 
was awarded to local school districts in New Jersey. 

• Assist the State Education Agency in establishing and improving 
^programs to identifly and meet educational needs at the State 
. and local levels, ttwring FY 1977,. $r,696, 8^9 was spent on 
"strengthening SEA" activities in New Jersey. 

A State Advisory Council advi^e^ the Commissioner and^his staff on pro- 
gram policy and administration and pV^epawes an annual evaluation of the 
State Program. This Report is the product of that latter (responsibility. 



The maj#r c6ordina,ting ti'tl^-IV in New JerSeywas the . \ 

integrated 'educatibnflil planning process* established for education 'in the 

' ^ ( '^'"^^ ' ■ ^ '. ■ V • ^ " . • ' • ^ 

Sta.teJ- This process,^*T&E {"thorough and effici'ent"*) » serves as a major , \^ 

organizer for the disparate elements of the Title/IV Program. Using the ' 

T&E process, the §tate, the intermediate units, and the LEAs are able to 

focus their tl|pravement efforts .and use available resources. in a moVe. 

.: . ■ ■ . . . 

•coherent and meaninlful- way. < „ . ' ' - , 

C. EVALUATION OF^ TITLE IV - " . . . . ' \ 

The State" Ti>1e IV. Advisory Gounci'T n's Vequir^d to evaluate all, progr^s 

and projedis assisted under the Title. Title 45, Code of Fed^^ral Regula- 

tions. Part 134.16 states: ^ - ^, 

The annual program plan shall provide for . . . an evalua- 
tiori by ,the State Advisory, Council at least atinually, of 
the effectiveness of«'' the' programs and projects assisted > ^ 
under^the annual program plan ... * i 

.* ■ *^ ' * * * > 

This regulation providesr'the authority for the present evaluation o1^ the/^ 

ESE/![ Ji tl e IV Program in New Jfersey. 

^This evaluation builds on that conducted for the FY 1976 Program. The 

0^ - 

methodolCrgies employed in that evaluation have been continued this year with 

■ ^ :J>-i^* ' ' / ' ' ' ^ 

some changes. Three basic (jMa collection processes were used in *he RY.1,&76 

i • ■ . ' ' ■ 

evaluation : ' 

" ■ \ 'J 

1) Documentation Rev^iew . Published reports, correspondence, 
and'Other documents were reviewed and analyzed. 

2) Interviews with SEA staff . The evaluators interviewed 
several SEA staff members -to obtain documentation arid to 
obtain other information. 

• ) 

3) On-Site Eva^ijation . For Part B, on-site interviews were 
conducted with local project administrators in a sample of 
districts. 

' ) ■ ' • ■ 
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^ In this year's evaluation, the following modi fication^p and additions 
iiave been* made to the FY 1976 process: 

An ' .interview schedule wasv prepared to standardize data 
collection during the Part B on-site evaluations. In ^ 
addition to collecting more uniform information, the 
question areas were expanjded for such topics as the 
project planning process and integration with the T&E. 
process. - , v ' 

2) 'A seff-a'ss.essment instrument was prepared for use witm>^^^ ^ 
^, all professional, staff engaged in strengthening SEA ; . 

activities. This instrument assisted in more^unfrorm 
data collection and focused attention on outcome and 
impact questions. ' / , y * 

3) A revjew of Title IV management activities was, initiated 
• on a small scale. This ar6a is viewed as a critical 

factor-in the overa^Tl development, of the Title JV Prp- 
gram.^fn New Jersey. 



D^p.ite thes^e improvements /there are still some conceptual and 
methodological improvements which can be macie in the evaluation design 
and implementation. These wi^tl be addressed in the individual sections 
arid in the overal.l recommendations regarding th0- Program., 

It should be emphasized that the nature of some parts of the Program 
makes it difficult to quantify valid and reliable measures of tmf^ct. 
Relating expenditures for library books to student performance, for exam- 
ple* is likely to be an insurmountable methodological problem for some 
tiiTie to come. Our real intent is to produce useful infbt^mation in response 
to important information needs'^and to make qualitative judgments abo^t the 
effectiveness of policies and actions. Where quantitative measures of 
impact are unavailable, we should not be pr^6nted from making fair'^a'nd 
sound judgments of effectiveness. ' ^ 
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d. organization. of the report" " , 

• ■ V-Ij 

.Each of the four major areas- are. treated indiv-idually in Sections II, 
III*, IV, and V pf this Report. For Sections IJI, IV and V, .a common; ' 
presentation format is. used. FoTlowfng an introduction, ;the. Department's 
compliance vrith process requirements j*n the Annual Program Plan is reviewed 
A separate section deals with an assessment of outcomes and impact of the 
Program. Finally, implications f^future planning are offered. Section. V 
which reviews the Strengthening SEAs Program, uses this same format with* 
each of the fi\/e major areas described in the /\|inua1 f^ogram Plan*. / 
• Because the documentation suppofting this Report is ^xterisive, all) 
•kppendtx materials, have been annotated and orgainized in four sections 
Corresponding to the four major evaluation sections of this Report. These 
aippendix listings are collected in Section Vl, Annotated Listing of Appen- 
dices. Finally, Section VII contains a listing of "Persons Interviewed." 

I, ■ • v. , . > - 
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SECTION II 
TITLE IV MANAGEMENT 



Despite the fact that ESEA, title IV is regarded as a single Prdlram, 
much attention is given^^to the three individual programs of which it is ^ 
comprise,^. Given that the three cqm^nents ^re r.elati vely diverse and 
unique and thus require individual assessments, it nevertheless is impor- < 
tant tp understand the admin.istrative. process for the total Program and 
• to assess the quali ty^ of the overall management of tf^a^^ 

. The Annual Program Plan (pp. 7-9) provides a description of the 
-.staffing pattern for the administrattpri of Title IV. While -the Commis- 
sioner of Education has overall responsibility for the administration of 
the State PlanV the Deputy Commissioner is delegated the responsibility 
for insuring that overal 1 managementV accounting, and interdepartmental 
coordinating functions are carried biJt.Vstate Plan activities are '-: 
V wonitared by the State Title IV^ Director, vjig.' hepb;rtis;dir^^ 
. Deputy CommisslPnerw.. ^ • 

No formal evaluation (questions were established ^for assessing the 
nianagement of the Title IV Program, nor did the original scope of the 
evaluation Address this area? During the process of data collection for . 
the evaluation of the three component program^, it became apparent that 
;an important facet of the Progrario^ was the day-to-day management provided 
by the Office of jthe State Title IV Coardinator. Rather- than postpone ^n 
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assessment of this area until FY 1978,' the, evaluator collected some i .* 
documentation arid made st)me observations which may provide useful infor- 
mation for the present evaluation. Should thisi area be included in the 
scope of the FY 1978 evaluation, a more sophisticated data collection 
and evaluation pr^cess;^;w111 need to be initiated. 

Compliance' with individual program requirements is assessed in 
Sections- III, IV, and V of this Report. ^ Two general areas of program . 



administration are addressed in this Section: i^^) . management procedures ,^ 
and 2) State Title IV AdvisoryCouricil involvement. 

B. PROCESS/ASSESSMENT * ' ■ , 

Management Procedures : ' 

Because of the large 'number qf persons involved in the New Jersey 
Title iV-B Program,, clear delineation of responsi bi 1 1 tifes is requirglH|r' • " 
Such delineation fs .accomplished thorough. the development o* . an pverall 
PERT Chart for the f^rogram (II-l)* The'^ ^ time^ 
'line -for the'pompletion of . each process requirement, together with a 
specification of piBPSbns responsible for the' conduct of each activity. 
The State Title IV 'Coordinator used the PERt as monitoring system and ^ 

-11 v. 

to signal the need for communications to appropriate Department' staff 
memt).erS' regarding required activities. y'-: 

Since a major/'pur^se of Title IV is the granting-of funds to local 
school districts under Parts B and C, the \qommuni cation process for passing 
judgment on individual grant awards is a major activity which must l?e ^ 
managed carefully. Because several signatures were required in order to 

*See Section VI, Annotated ^Listing of Appendices, for all references. 
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process a grant award, 'a routing slip and process were established to 
r insure sound fis.caV management and to introduce appropriate chfecks and 
balances intp the grant award process. (II-2). 

Communication is a majov^ on-going activity of the Office of the State' 
Titl:e>^iV Coordinator..' For this reason, the Coordinator and his staff * 
mairytaih both formal and informal cdmmunications with the many individuals 
^.responsible, for the conduct of specific activities.. Appendix II-3 con-' 



tains ^ sample of the cdmmuriications sent out by the Coordinator. These 
commuhi cations cover such activities as: 1) alerting appropriate staff; 
to time lines and process requirements; 2)^, assuring that Title IV is 
, publicize^^adequately in : IriAeract , the Department new3paper; and, 3) com- * 
miinicating with officials outside New^ Jersey at federal and state: levels. 
, ; Title IV-C provides a major source of funds for program development 
and dissemination in New Jersey, for this reason, the Title IV-C Program 
was reorganized; during FY 1977 to strengthen the Department of Education's 
e-fforjts to implement T&E. The reorganisation resulted in a greater inte- 
gratipn of iV-C operations with other developmenj^and '^rfiSsemination efforts 
in t'he Department. Program visibility was maintained in the Department 
and in local school districts. 

Ihe reorganization plan assigned responsibility for major Title IV 
processes (e.g. , determining priorities, fiscal management, and technical 
asJ;,istance) to specific Department units. A chart described the processes 

and responsibilities of each unit (II-4). ' , . 

■■...■■» . ' 

State Title IV Advisory Council Involvement 

\^ 4 The\^ate Titlo IV Advisory Council (SAC) plays a central role, in the 
Title 'IV Program. Its functions are to: 
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1) ,advise^the;$t3t6 educat^^^ agency on the preparattc%^,' 
' • '{1 . -vOf J and policy matters arisifig in the adm.nistratibii^^^^^ r ,^ 
^ v;^^^^^^^^^^^ program plan, including fh^ development 

' ' / ' ^ - of cri'teria for the distprbution of funds and the 
c V • ' /approval of applications for as'^istante under Title IV ■ 
. /of the Act. \ . / . l> f 

'^j ' - '-'2).- evaluate all programs and projects assisted i^n^ 
- Title IV of the Act at least annual 1y. 

3) . prepare^ at, :leas:t annually and su^ thp 
^ *State edfuciatibnal Sgenc^^^ itjs activities, ^ . • / 

.v; • ' recommendations, and: evaluations , together with such ,. -. 

additional comments as the State educational agency i.- 

deems appropriateV; to the Commissioner. {Ani^ualy. ' . " . 

Program Plan, p. 17) ^ . v i 

While it is not wi thi n the scope of this^feport to as$ess Stat^ Adyi-/>^^ 

sory Council activities, it is important , to document that the SAC has 

been involved in an •appropriate, advisory capacity to the/ Commissioner -qf 

Education and to. hi5 staff. It is the role of Title IV managem.ent to /. 

insure -that the SAjji" i^ iriformed and provides advice concerning major /v ; ^; 

program activities'^ > - • . ^'V 

The SAC meets bpth as a total group, an^ In 't subcommittees: 

^ • Title IV/ Par t^^fr^^^^ Title IV, Part C;"3indv 3) Evaluation and State 



lies provide documentation o;^ the nature 
total group and subcommittees) in 



Plan.: ^/^^^ agendas and minu 

of the involvement of the SAC (both 
the. Title IV Program (II-5). , \ 

A review of the agendas and minutWjnel^iG*^.tes that the^AC was 
involved in the following major Program decisions: \. 

1) Review of FY 1977 Annual Program Plan 

2) - Review of title iV-^B-. Program activities 

3) Rfevjfew of Title IV-C proposals 
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4) On-site evaluation of Title IV-s^t; projects 
" ' 5) -Oversight of the evaluation of the Title IV Program 

C. DISCUSSION 

As was* pointed gut previously, a formal evaluation of the management 
of Title IV was not contemplated within the scope of work. The importance 
of this component is such that future evaluations should address.it more 
thoroughly. The comments made below are offered in light pf the obvious 
limitations of the assessment process lised for this year."^ 

In general, the managemerit component of the Title IV Program appears 
to be, functioni ng in an. exemplary fashion. Overall management processes 
appear sound and the Title,^V management staff .flPpear to work as a team 
despite the fact that they are dispersed throughout the Agency. Manage- ( 
ment systems and communications arp the|rti^ajor tools for mairitainirvg 
program activit^ies on schedule and* in compliance with the Annual Program 
Plan. Program staff appeared well informeti of the ever-changing federal 
regulations and requirements affecting the Program. 

Jihat the New Jersey Title IV Program is administered in an exemplary 
fashion is attested to by the U.S. Offipe of Education's ' invitation to 
the State Title IV Coordinator to make presentations on various aspects 
of the New Jersey Title, IV Program at national conferences (11-6). Other 
states ha\(e sought information and advice from the New Jersey Title IV 
Program staff in addressing problems and issues related to Program manage- 
4nent. 

The SAC appears to be adequately involved in all appropriate Title fV 
activities. The evaluator has attended SAC meetings and has found the 
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members to be enthusiastic snd -energetic in the conduct of their respon- 
sibilities. The State Title IV Coordinator communicates frequently with 
the SAC Chairperson'. 

D. IMPLICATIONS FOR FUTURE PLANNING 

Because no formal assessment of the management of the Title IV 
Program was undertaken during FY 1977, it would be inappropriate to Vug- 
gest improvements for consideration by the Title IV staff. Because of 
its importance, however, the SAC should consider whether such an asseSs- 
mentrbe made a formal part of the FY 1978 Title IV Evaluation/ 

An evaluation of the management of Title IV/ should address, at a 
minimum, the following elements: 

1) planning 

2) quality control procedures' 

3) comnjjpi cation 

4) personnel management 

- 5)*^State Advisory Council involvement 

6) /monitoring and evaluatipn procedures 
""■^^ dissemination 
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SECTION III 
' TITLE IV- B 

LIBRARIES AND LEARNING RESOURCES 



A. INTRODUCTION 



- Under Title IV, Part &, grants to the stj'ates are authorized for, the 
following purposes: ' 



T 



1. for the acquisition of school library resources, textbooks, 
and other materials printed and published; materials for 
iJse by children and teachers In public and private schools 

2. ' Tih" the acquisition of -Instructional equipment (Including 

laboratory and other sped aV equipment, including audio- 
visual materials and equipment suitable for usfe iri.^- 
-vlding education in academic subjects) f^r use by children'' ' 
in elementary and secondary schools, and for minor remodel- 
ing of laboratory or other space used 'by such- schools for ' 
such equipment - ^ 

3. for a program of testing students in the elementary and 
secondary schools; programs of counseling and gujdance — 
services for students at the appropriate levels in 
elementary and secondary schools; and programs, projects 

and leadership activities designed to expand and strengthen 
counseling and guidance services in elementary , and secon- ' - 
dary schools 

the Act contains requirements providing for -the equitable participa-r 
tion of children in private, non-profit schools/ It funther provides for, 
the distribution of funds according to 'enrol Iment, except ^hat LEAs. with 
a greater tax burden or a-. higher percentage of .children from low-income 
families would receive "substantial funds. 7 

Beyond the^e limits. Part B is a highly flexible program, since the 
Act specifies that e^ich local agency be given complete discretion to. 



spend "funds within the three categories listed above. Local districts also 
have autonotny in identifying priorities. and in evaluating their projects. 

In New Jersey in FY 1?77, 570 out of a total of 589 operating districts 
applied for and received funds. Thirteen non-operating districts and nine- 
teen operating districts did not apply for funds. The net allotment ^ for 
the funded districts- was $4,589,353 .(see Appendix IV-B^l).* This compares 
favorably with FY 1976 when 535 districts applied for and received $2,023,672 
In that year, fifty-five operating' districts did not apply for funds. ' 

Evaluation Questions 

Evaluation of Title IV-B is directed at acquiring evidence to answer 
three basic questions: 

r ■ ■ . . 

• To what degree' has the process for conducting and managing 
Title IV-B as projec,ted in the Annual Plan actually been 

, , carried out during the year? 

'J , 

• To wha-t extent is the process itself likely to enhance or 
/retard accomplishment of desired Title IV-B outcomes? 

• To what extent have outcome objectives for Title IV-B 
actually been achieved? r - 

r 

Evaluation Methodology , 

The Annual Program Plan for Title IV-B for FY 1977 was reviewed and 
compared with that for FY '1976 in order to identify new objectives or 
activities for the program. All process requirements described in the 
, FY. 1977 Plan were identified. For each process requirerpent, documentation 

'J ■ .. . ■ ■ 

and other evidence was sought to establish that the process requirements 
.had been addressed. Finally a judgment of quality was made regarding , 
the manner and form in which the requirements' were met. 

■*See Section VI, Annotated Listing of Appendices, for all references. 
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Also, since this was the;' seep nd yfeir in. which an evaluation of the IV-B 
Program was conducted, recommendation? frojiKthat evaluation were reviewed., 
and evidence was fought as- to what had been done In response to the recom- 
mendations. - 

To provide more detailed information regarding the use of IV-B Tunds 
at the local level, the Department of Education conducted on-site inter- , 
views in a representative sample (N*38) of districts. An interview Schedule 
was prepared covering such areas as the proposal development protess, inte- 
.gration with T&E, and assessment of the Department of Education's assistance 
in IV-B project development. • The completed interview f^^s were supplied 
to Educatiojnal Consulling Services for analysis. A report on the results of 
the on-site intervie\^s is contained in Appendix IV-B-2 and is discussed below. 

The text of this Section is organized to follow the FY 1977 Annual' Pro- 
gram Plan. Page references to the Plan are provided. 

; - -r 

B. .ADHERENCE TO THE PLAN ^ ' ' \ 

1. Fina^ncial Data Submission (Annual Program Plan, p. 32) ^ ^ 

The Program Plan stated that 

Appl/ication forms will require cHstrict45 to submit data ihdicat-- 
ij:ig financial support at the local district level and showing 
maintenance of effort in the three categories of Title IV, 
Part B. The LEA will be required to show maintenance of effort. 
Private schools are not required to demonstf^ate maintenance of 
effort. 



Documentation 

The New Jersey Department of Education's "Project Application, ESEA, 
Title IV-B" (Section D, p. 5 - IV-B-3) required only public schools to 
show actual local and state expenditures for^75-76. The applications 
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from LEAs provided this *hifbYniat1on for the three categories of Title IV, 
Part B. ■ ■ . 'v ■ * 

During FY 1977, the maintenance of effort requirements were extended 
to apply to both public and^non-public schools. This r^equirement was made 
in April, 1977, making it impossible -for the Department* to implement it fo* 
projec-ts already funded. This requirement, however, is r^lected, in"tlj^ 
FY 1978 Annual Program Pla(n. 'Regulations for this legislative change have 
not been established aPs^f the writing of this Report (IV-B-14). 

•■ • ■ ',. ' . " ■ . 

2. Criteria for Distribution of Funds (Annual Program Plan, pp. 32-39). 

Section^40Jfa) (/f th^ Act requires State Plans to provide assurance that 

funds such acfency ireceives frora.approp»*iations made under 
Section AOlfa) vyill be distributed among local educational 
agencies according to' the enroTlments in public and non- ^ 
public schools within the schoot districts of such agencies , 
except that subst^intlal "fupds win be provided to (i) local 
educationaV a^je^c^es whose tax effort *for education is sub- 
staritially greater than the state ^tverage" tax effort for 
education, but whose per pupil expenditure (excluding pay- p 
ments made under Title I of this Act) is no greater than the 
average per pupir expenditure in the State, and (1i) 1o^:a1 
educational agencies which have the greatest number or per- 
centages of children whose education imposes a higher than . . 
average cost per child,- such as. children from low incpme fami- ^ 
Ties, children living in sparsely populated areas, and child- 
ren from families in which English is not the domftiant language. 

States were required to develop criteria for the distribution of 

Title IV, Part B funds which would meet these- conditions for distribution. 



Document ation 
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The 19761-77 Annual Program Plan, Section II. 4. 2, described the criteria 
for distribijtion of funds bas^d on three foVmulas designed to satisfy the 
requirements of the law (IV-B-4). That distribution of funds 'was made 
through -^hese fqrmulas is demonstrated in the case' of dis^;feftct*s in Ess^x 
County as an example of the allocation process llV-ff^). 

UN4 



-3. Notification of Per Pupil Allotment (Annual Program Plan. p. 32) 
. The Program Plan states that ' • . 

Each local educational agency, upon the completion of the 
computation of its district's allotment according to the- * . 
formula, will be notified of their per pupil funding, as 
'well as the basis, of the computation of their tot|il dis- 
trict's allotment. TIte notification will also include the 
• listing by school of the number of students and the extent 
of suggested participation of each non-public school within 
the geographic boundaries of the LEA. 

Documentation ' ' 

The notification of the LEA of its'per pupil funding by school /includ- 
ing public and n^-public) is illustrated by Appendix IV-B-6,' a sample 
computer print-oii't notification for the Newark' Board of Education. A 
letter of notification is shown in Appendix IV-B-7. / , ,^ 

4- Report on Enrollment (Annual Program Plan, p. . 32) 

As required by P-L:^.93-380,^ Section 403(aK^ , ..the Program Plan 

states that on application, ( 

JJIAs win report the enrollment of children in the public 
and private schools. The LEA in consultation with admin- 
istrators of private schools will include the enrollment 
of private schools who will identify studjents required, ^ 
by Ijhe formula for allocation- 

Cfecumgntation ^ ^ ^ ' 

Basic data on enrollment in both public ^d. non-public schools are to 

be reported in the LEA' Project Application Form: public school enrollment 

' ■ ■■ ■ ' 

data in Sectfo-n A and non-public school enrollment data in Section F (IV-B-3) 

5. , Single Application (Annual Program Plan, p. 32) 
The Program Plan states that ■ ' ' 

A^^single application will be sent to the LEAs. 

. * . III-5 V 



This requirement reflects the desire of Congress that 

local educational agencies applying for funds under any 
program under this title shalV be required to submit pnly 
^ one application for such funds for any one fiScal year 
(P.L. 93-380, Section 403(a)(7).). \ 



Documentat|ion 



The PIrogram Announcement accompanying the /Guidelines (Hr-fi-8) stated th^t 



on 



The single application.package replaced separate LEA applica- 
tions for Title II, III, and V. previously authorized und^r 
the Elementary and Secondary Elducation* Act and'Title Ill of 
the National Defense Education Act.. / 

A single application package for Title IV was sent to all districts 

September^g, 1976 {IV-B-7). 

In reviewing IV-C proposals, the State/Advisory" Council' determined that 

there was. not a sufficient number- of fundable t)roposals submitted. Since 

unexpendid. dollars were available, the Council requested a reopening-of the 

application period , and this reopening was extended to those districts which 

did notj^;M^dy receive TPart B funds (IV-B-7). This second request'for 

appli^tions was authorized by a memorandum issued by the U.S. Office of 

Educ|tion (IV-B-9); Through this second effort, the Department of Education 

-wa^^abfe to award IV-B funds to an additional seven districts. 

6. Instructions to Accompany Application Forms (Annual Program Plan, • 
p. 32) — \ . 

The Program Plan specif ies that , 

The application forms, which will be sent to the Superin- . ' 
tendent or Administrative Head of each operating LEA,, will 
be accompanied by instructions for any section that is not 
clearly self-explanatory. The instructions will include 
the operative deadline dates for the submission of the 
application, as well as the claim form. ; 
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Documentation ■ 

Guidelines for completion of ESEA, TJtle IV-B were disseminated with 
-the application forms. The Guidelines provide for each, of the three 
corppoVients of Part B, explanatory information, examples of eligible use 
and ineligible use. of funds standards and'basic limitations^ and other; 
|jistruct1ons for completing the application form (IV-B-8). 

The Program Announcement accompanying the Guidel.ines gave the date 
for^ the receipt of IV-B applications as "January 7, 1977 postmarked, or 
January 10,^ 1977 .jiand delivered." The closing date for applications for 
the sec(|J|^ was set for May 2,, 1977. 

7, Technical Assistlince (Annual Program Plan, p. 33) • 

The Rrdgram Plan states that 

Technical assistance will be provided to local educational 
agencies in project development: 

(1) identification of needs,, short range and long range planning > 

(2) establishment of priori ties, immediate and long range 
.(3y development of program objective's 

(4) monitoring 

(5) evaluation 

(6) dissemination 

I . . • ' ■ 

Documentation ' 

Orientation sessions on the purposes, regulations, and method of / 
application for, Title IV-B funds were held during the year at each of thk 
Educational Improvement Centers (EIC). The information conferences varied 
in length up to three, hours. Almost all districts were represented at J 



one of the sess 



;ions. A schedule of the orientation sessions, held^during 
the year itf attached as Appendix IV-B-10. , ; 

In addittop, numerous telephone inquiries and letters seeking clarij 
fication or answers to questions were resppnded to by State Department 
Staff. Findings of the on-site evaluation teams .indicate that districts 
were generally well satisfied with assistance provided by the Department 
of Education. * ' . '\ . ' 

" ' ' • , ••• * . ^ ■■ 

. ' • . f , ' • ' • 

8. Ihservice Edux^tion (Annual Program Pldn, p, 34) 

• ■ ^ * " 

The Pi^ogram Plan states 



S 



Wbrkshpps will be conducted for 'Department, County and' 
Educational Improvement Center Staff concerning procedures, 
arid requirements of Part B Title IV. County offices and/ 
or Educational Improvement Centers will conduct, orienta- 
tion sessions for LEA and non-public school staff. 

Documentation 

Information conferences were conducted for Department, County, and 
EIC staff concerning procedures and requirements of Title IV-B (IV-B-10); 

9. Evaluation and Reporting Procedures (Annual Program Plan, p. 34) 
^he Program Plan specif ies .that districts must report expenditures 
to demonstrate that federal funds are not supplanting local fOinds. The 
Program Plan states that Part B Programs will be monitored oh a sampling 
basis, and that evaluation will be carried out using a self-evaluation 
questionnaire. 

Documentation 



. Although the use of a, self-assessment questionnaire was proposed for 
all recipient districts in FY 1977 (as it was in FY 1976), the Advisory 



Council again amended this requirement'- and substituted the use of an oh- ' 

/ « ■ . • J ^ * "• • ' 

site .Interview process. This afnendment was in consonance with the Depart 
ment's policy aimed "at re4oclng the papelvork burdens' ot:itpc school 
districts . The Report of 'bindings of On-Slte Evairuatioh^ -yQ|f ft. Sample of 
Tit 1e , .1 V^Bt J^ro j y tg- 1 s contained in Appendix IV-B-2 and disdussed below. 

10.4^ Local Discretion on Use of Funds (Annual Program Plan, p. 35) , 
The. Program Plan" states that each local educational agency will be 
given complete discretion, subject to Title IV, P.L. 93-380, In determin- 
ing how funds it receives will be divided among the various categories" of 
expenditures and the. various school buildings. 

. ■ ■ - . ■ .■ , f: ' S ' 

Documentation . ' 

The categories of expencji tures planned by public and nort-pfjb.1^1,c 
schools is shown in Table 1 on page Illrld: The most frequently chosen 
category, for both public an^l hbn-pubWc schools was library resburces; 
the second inost frequent choice was a combination of library resource? ' 
and instructional equipment'. -Nevertheless, NewvJersey schodls jn ,the 
aggregate made use ;of all the pT'ovisions of Title IV-B, and of combinations 
of them, ^ ' ' '"V*^. 

Data from the bn-site interviews indicate that a significant propor- 
tion of non-public sfehaols selected expenditure categories which were ^ 
different. from those selected by public schools in the same district. 
Within^ districts, expenditure patterns varied, with few schools using 
funds for equipment. The predominant fund allocation procedure within 
districts is in relation to pupil enrollment;' ' 

III-9 , ^ 



TABLE 1 , 
Tories of Planned Expenditures of Title IV-B Funds ' 
by^ublic and Non-Public Schools 
FY 1977 



Districts 



Expenditure 
Category* 




; ' [■_■: '■ ^ Expenditure Categories j;";,, 

A# Library ftelsources and Other . Iris true tioija^l;!^^^^^ . 
B, Instructi-ona.! Equipment aha'Mih'or Refrioc^^^^^ i 
iG. Guidance, Counseling., and Testing " 

D. , (A) arrd (B) above ' v*^ /: 

E. ' (A) and (C) above r 
F; (B) arid.{C) abovj6 ' . 

G- ^A), (B) and (C) above , ; ' 
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Nop-public; Schools aiqe.not ^organized by dis;|:rict, but- 'are included for the 
purposes of TTtl^ IV under the LEA in which ^tHe schools ;aj^e:\geographicaTly 
located. ^ ^ ^ 

^ ^ ' ■ ■ ., - -• . ■ . 

Source: . Da supplied by the New Jersey Departnieht of Education, 

Division of Research, Planning ?ind Evaluation ''''W-'-^'h^^ 
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11. Assurance of Distribu'tiofi of Funds and "Ma jfttena nee of. Effot^t" 
(Annual Program Plan,' pp. 36-39,) ; 7^ 

• \ In.. the Program Many th^ SEA assured that funds received would be*^ 
, distributed among LEAs 'accqrdlng to enrollments In their public and npn- 
,V public schools. 'v 
■ . The SEA also assured' that the aggregate amount, to "be expended by thf v,,; 
State and its local educational .agencies" from nbnsfederal sources .would ^ 
•not be less than the amount expended for IV-B related programs in the ^ 
^ precjBding fiscal y^^^ 

Documentation 

A surmiary of SE/< maintenance of efh)rt shows a State' total for FY 1975- 
76.of $91,302a41-.a^ for FY 76-77 of $98,550,603 (IV-B-ll). /. These figures 
compare favorably with the FY 1976 totals.v ' ' ? 

. \ Orf a per pupil explpndlture basis, ma-inteqance of effort was' also 

. established. For FY 1976, -$59.40 was spent per student, while in FY 1977 

^ V ■'■ ■ . V' '. .. .:■<,■■ 

'.this was increased to $64.02. ' ■ 

■ . ■ ■ ■ - ' ■ ■ ■ ' ■ . .. 



C. ASSESSMENT OF THE PROCESS 



■ For th-e, most part, the program requirements of Title IV-B appear to 

have* beeji met' ) n 'New- Jersey In FY l§!77. Documentary evidence amply 

denjonSj^rates that the SEA fulfilled all of th!^ procedur^ steps outlined 

in the Annual Program Plan. These fncluded: 

• collecting enrollment and financial data for publjc and 
. non-public schools^ 
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• developing and Implementln^crlterl^l" for,„appropr1ate 
distribution of funds, lilPodlng a formula to co^ensate 

... d1str1cts .l9Hih a .grieater fl^^^^ ^ y-- - . 

• 'the preparation of U appliciittort^^ 
Instructions for local sdJibol personnel . ' ; 

• devel opi ng a method fot rioti fyl ng LEAs of " tVeir per-, 
pupil allotment;, by 

• • • - ^^^ assistance to LEAs, through Initial 

v. orlerttattbn^WorkshOps and continuing communf'catlbn -with 
district personnel requesting aid Ct,; , 

• assuring local discretion In the use of IV-B funds 

% assuring equitable distribution of funds, maintenance 
,of effort on the state level In. the aggregate amount 
expended'' , 

providing LEAs with a singife ap^^^^^^^ In two parts i 

i- . : for IV-B and IV-C funds - 'ty-y^^ \-^: - ■/ ■ . 

• assur^ng'maintenance of effort for adgrega^^^ 
for Tf tie IV-B ' 



Severatp^ procefjures were found to be particularly^ ' 

effective: . • ■ 

l). Part B Allocation Formulas . This complex set of forniiilas 
Sippears to respond to the, letter and the spirit of the lejglslatlon. The 
foi»m61as have been cited byvthe U.S. Office of Ed;ucat^^^^ adopted or 
adapted by other states. ^ : ' ' 5^ .'^^^ ^ 
^ . 2) ^ ' Efforts to ^In^olve School Districts . The Departmen^^as abl 
tQ Rr-Ovid><Eunds to 570 school districts during FY 1977, an incirease of 
thirty-five oyeiip^ FY 1976:- A second application opportunity was extended 
to all districts which^did hot' a^^^^ and seven new districts 

were funded. - . , 

., 3) Non-public School InvblvemeRt , Ninet^y-seven p^rcent of all 
eligible districts partlclda^ed In Title IV-B in fV 1977 and 94 percent 
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of all non-pubHc schools also parti ci pa ted^^^^he Department took several 
steps to extend Title IV-B dollars to alV^eligible districts and non- 
public schools. The results of the on-s|ite evaluation indicate that 
there is appropriate non-public school iVy^l vement, ^ 

4) Communication with districts and with appropriate school 
officials regarding the availability of Title IV-B funds was more effec- 
tive in FY 1977 than in FY 1976. it is likely that the newness of the 
Program in, FY 1976 was the major impediment to timely and accurate com- 
munication. The Program is known more widely after two years of^operation, 

5) The on-site evaluation report indicates that project manage- 
ment at the district level was above average with respect to such fiscal 
requirements as separation of accounts, management of funds, and labeling 
of equipment and materials. Overall management of^ the projects (e.g., ' 
preparing reports and monitoring) was also rated as above average (IV-B-2), 

In terms of process improvements during FY 1978, some consideration 
should be given to increasing the size of the sample for on-site inter- 
views. A U.S. Office of Education Discussion Guide advises that "an 
evaluation scheme should be developed so that Part B projects in every 
participating LEA will be evaluated nidre thoroughly within a reasonable 
period of time (IV-B-13).- Given that sample sizes in FY 1976 and 1977 
have averaged about thirty-five districts, the Department may wish to 
consider increasing the size of the sample for the FY 1978 evaluation. 

Measuring impact of Title T«^(^B (a topic to be addressed in the next 
section) is not likely to be entirely possible over the short term. The 
same Discussion Guide recommends that when Part B funds are linked to 

III-13 
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long or short-range plans for educational improvement, the task of assess- 
ment will be easier. This advice is jn line with a recommendation made 
in the FY 1976 evaluation report.-^ 

The Department /is advocating the use of Part B funds to support T&E 
efforts but, given that most districts are in the early stal^ges of the 
process, it may be too early to expect a link between Part B and T&E. 
The predominant mode of allocating Part B funds within a district is on 
a per pupil basis. Such a procedure dilutes the already , meager funds 
which are available to most LEAs and makes i^npact assessment more dif- . 
ficult. • ' * 

The Annual Program Plan does not require LEAs to evaluate their proj- ' 
ects although each district is required to be accountable for its use of 
the funds. Determining the impact of Part B funds on student learning 
is impeded by the relatively small size of the grant for many districts. 
Were valid and reliable impact measures available, it appears that the* cost 
of employing them might not be worth the value of the information. 



D. ASSESSMENT OF OUTCOMES AND IMPACT 

While it. is possible to identify outcomes for the Title IV-B Program 

♦ .1 •' « 

'J . ■ . 

and for each of the projects, it is difficult to assess fehiaj: impact of 
Program or project activities on student or teacher behavior. Even in 
those cases where Part B funds are used in support of another project's 
objectives, it would be difficult to assess the unique con.tributlon of 
those funds to the impact of the larger project. - For example, .it ys 

Statewide Evaluat ion of E.S. E,A. Title IV in New Jersey for Fiscal 
Year. 197 6, Education "^an? Publ ic Affairs, September 30, 1976. 
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possible to identify the outcomes^ of Title IV-B expendi-^^res in t^rms of 
, library materials and equipment. It is. much more difficult to assess /the 
impact of the materials and equipment on student learning. 

In terms of Title IV-B outcomes, the on-site evaluation studies 
indicate that the funds are spent to purchase needed materials in support 
of an on-going or hew project or program. Districts tend not to use the 
funds for testing, counseling, and guidance programs. The expehditur.es 
by category for non-public schools nearly parallel those of the public 
schools. 

As , evidenced by the on-site evarluation, studies >, local discretion has 
not resulted in frivolous allocation of funds, although it appears to be' 
the case that the targeting of the limited funds to a particular school 
or program demonstrates more measurable impact. Meaningful integration 
with the local T&E process also appears to enhance impact. Finally, 
'maintenance of effort for state and local districts does not appear to 
^be impeded. During FY 1976^ and 1977, New Jersey has been ,able to exceed 
maintenance of effort requirements* 

In an attem|3t to provide more useful information regarding processes, 
outcomes, and impacts, a structured interview schedule was used in on-site 
visits by a trained team of interviewers. The interview guide contained 
questions addressing such areas as developing the proposals, integration 
of the IV-B project with T&E, allocation processes, project outcomes and 
impact, administrative procedures, and Department of Education services. 
As a means of providing an assessment of outcomes of the Title IV-B 
Program, the following summary statements taken from the On-Site Evalua- 
tion Report are provided. * ^ 

III-15 
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• 1) The .needs identification processes used by districts vary 

considerably. Jn most cases, one or two individuals in the central office " 

' ■ * 

made a determination of the area in which funds would be u^sed. The 
speci^fics of spending the money of ten were developed by. a small group of 
teaqhlrs or principals. 

2) The majority 6f districts undertook a proposal development 
process which'was judged^ adequate by the interviewer. 

3) The. quality of the non-public school involvement was rated 

A 

adequate or above for those districts havypg non-public schools, 

4) The most frequently used ward for describing the proposal 
development process was "meaningful." ♦ 

5) A substantial 'majority of ^ the districts are involved in either' 
the first or second steps of the T&E process (i.e,, goal setting or standard 
isetting). This would appear to inhibit integration of IV-B with T&E at 
these early stages of , development. 

6) In only a small number bf instances (5/38) were IV-B objec- 
tives fully derived from the districts' T&E objectives. 

7) The allocation .of funds to Program areas by the sample paralleled 
that for the total number of districts (see p. III-IO). This would appear 
to validate the representativeness of the sample. . 

- 8) Thirty of the thirty-eight districts allocated IV-B monies on 
a per pupil basis. 

9) While project administrators could jdentify the tangible out- 
comes of the use of the funds (e.g., materials or equipment now in use 
where they were not available previously), questions of impact ori student ^ 
or teacher behavior rarely weref addressed. Local project directors 
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generally are not disposed to' think of Part B in terms of student, impact. 
The Department does not require impact evaluation. 

^ 10) All project administrators reported that they would achieve ' 
the^objedtives specified in the proposal. Their objectives generally were 
written in te;^ms of simple process requirements such as, "purchase appro- 
priate library materials." In one or two instances, objectives were at 
the other end of the continuum (e.g., raising the reading performance 
levels of all elementary school children through the pLfrchase of $1000 m 
.of, books). ' . ^ , 

11) Administrative procedures were rated as more than adequate 
or excellent for all projects. 

12) Those districts that used available Department of Education 
Part B services rated them as excellent in the majority of cases (16/23). 

These, observations appear to support the judgment made b>' the on-si te 
interview team in their report completed during FY 1976. Quantifiable 
data on impact is not available. Nevertheless, the judgment of all members of 
the team is that the money is having dn' impact commensurate with^ts size. 

E. IMPLICATIONS FOR FUTURE PLANNING 

The FY 1976 evaluation report made six recommendations for improving 
the administration of the Title IV-B Program. The Department's responses 
to each of them is reviewed here prior to offering some suggestions for 
improvements in the FY 1978 Program. ^ 

The FY 1976 plan suggested that the Department encourage districts 
to link IV-B expenditures to T&E and to encourage focusing expenditure^ 
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on particular projects, schools or grade levels. In botW cases the 
Department has advocated such approaches in its orientation workshops. 
Nevertheless, Tocat autonorny in both areas is guaranteed by the federal 
legislation and it is not likely that th&p Department wil 1 be successful 
in the short term in realizing either of these objectives. 

A third recoiranendation wis that the Department disseminate descriptions' 
of exemplary projects to LEAs. Such dissemination might provide models 
of good practice f^r other districts in the State. In FY 1977, the Depart- 
ment did identify five exemplary projects and these projects were given 
awards at the annual Educational Development Conference (IV-B-12), : 

The FY 1976 report also recommended that the Department investigate 
reasons for the relatively limited use of Part B funds for guidance, 
counseling, and testing. No such analysis has been undertaken during 
FY 1977, although several factors would appear to Explain th^ phenomenon.' 
A few possible explanations are: 

1) the tifle of the Program (Libraries and Learning Resources) 

2) insufficient funding -in a large number of districts " 

3) staff procurement red ±ap^ (relating to guidance and counseling) 

4) relative ease of using IV-B monies in other categories ^ 
The Department was advised to design guidelines for local evaluation 

of IV-B projjfects. No such design work was undertaken. Nevertheless, it 
i^ possible that some simple format and examples migW be prepared for 
dissemination. 

Finally, the FY 1976 evaluation report advocated that the Department 
broaden the distribution of notification of applications for IV-D funds. 
It is apparent from the level of involvement that adequate communication • 
is now taking place. 
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Based on a review of Title IV-B administrative processes and on the 
Report of Findings On-Site Evaluations , the following suggestions are 
made: 

^ 1) Formaljze the selection of Title IV-B exemplary projects usitig 

. *i ' ' ' ■ • 

the entire population of projects from which' the selection is made. 
Self-nomination may be an appropriate way to narrow the field. Adapting 
some of the procedures used for reviewing Title IV-C projects may be a 
means of transferring some of the clarity and accountability of the. 
Title IV-C process *to the best IV-B projects, . , 

2) Broa^^en the dissemination effort for Part B exemplary projects. 
Consider using publications and presentations at orientation sessions 
arid workshops in addition to the awards presentation at the Educational 
Development Conference. Disseminate information about projects that focus 
IV-B monies on special prjs^ects or target populations or which are inte- 
grated with the LEA T&E (Jrocess, ' 

3) Provide LEAs with a wide range of sample objectives which are 
meaningful and usefuV, Suggest ways in which simple assessment techniques 
can be used to ascertain whether the money is being well spent. At the 
State level, consider the use of a select number of carefully developed 
case studies to illustrate the variety of exemplary uses to which IV-B 
f^nds can be directed. 

L. ■ 
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A. INTRODUCTION 



SECTION IV 
TITLE IV-C 
EDUCATIONAL INNOVATION 



The pu/pose of Title IV-C, Educational Innovation is to provide for 
the development and dissemination of innovative and examp'lary programs 
and practices addressed to the priority educational ne^ds of the State 
and local school districts. While most ESEA programs focus on particular 
student populations, Title IV-C, Educational Innovation focuses on the 
developrnent i3f 'solutions to important school problems.^ A portion (15 per- 
cent)' of IV-C monies are targeted to the develofJfnent of innovations for 
addressing the needs of handicapped^ children. 

Title IV-C represents an innovative approach to development in that, 
^solutions to school proble^jjs. are designed, tested, and validate?! by^ prac-. 
tition^rs in schools. This is In contrast to the research and development 
activities conducted by nationa: educational Laboratories and Centers'' and 
. by institutions of higher educatjion. The. hypothesis is that practi tioher- 
developed programs and practices will be more readily adopted and adapted 
by other school districts than those resulting from research and develop- 
ment in settings other than LfAs. ^ \\ 
.O By-'facilitating the diffusion of validated programs and practices 
tl^other school district's "tn the country, Tit]^ IV-C monies, can be used 
more efficiently, reducing the cost per child of the development expenses. 
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At the fedleral level, the Joint Dissemination Review Panel in the Educa- 
tion Division reviews the best of the d*^velopment outcomes and provides 
resources for diffusing the exemplary ones. At the st^te level, IV-C 
resources are used to diffuse s^tate validated' programs. 

Building on the activities and accomplishments of ESEA, Title III, 
Title IV-C has expanded the quantity and qual ity of programs available^ to 

address important school management and leaVning problems. The Title IV-C 

... • . ' ■ ^ I' 

Program in New Jersey is attempting to promote such expansion and improve- 
ment throughout the State. - . ^ 

Fiscd^ year' (FY) 1977 was the first y;ear of ful 1 implementation of 

the IV-C, Educational Innovation Program^" The bldJitle III and the new 

■ . ■ - . ■* 

Title IV-C operated concurrently in FY 1976. The FY 1977 Program is a. 
continuation of those IV-C activities begun in FY 1976. For this reason, 
the evaluation of this component builds upon that done in FY 1976, sup- 
plementing new material where appropriate. 

^ \ .... 

Evaluation Questions . * . v 

Evaluation of Title IV-C is directed at acquiring evidence to answer 

three basic questi^ons: ^ . 

. • To what degree has the process for conducting and managing 
Title IV-C as projected in the Annual Plan actually beep 
carried put during the'yee^r? 

• To what extent is the process itself likely to enhance or 
retard accomplishment of desired Title IV-C outcomes? 

• To what extent have outcome objectives for Title IV-C 
actually been achieved? 

Evaluation Methodology 

The Annual Program Plan for Title IV-C for FY 1977 was reviewed and 
compared with that for FY ^1976 in order to identify new objectives or 

• - ' '■ 'lV-2 ' ' 
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, activities for the Program. All process requirements described in the , 
FY 1977 Plan were, identified. , jpor each process requirement,, documenta 
and yth^r evidence was sought to establish that the process requirements 
had been addressed. Finally a judgment of quality was made regarding the 
mariner and form in which the, requirements we^^. met, 

Al50, since this was the second yearM'n which an evaluation of the 
IV-C Program was conducted, recopiendatibns from that evaluation we!re 
reviewed and evijd'i^nc^ was sbught as to what had been done in response to 
the recommendations, ' 

' The text of this Sect.ion is organized to follow the FY 1977 Plan. 
Page references to the PT^^hre provided, 

B, ADHERENCE TO THE PLAN; 

1. S-tatg Priorities and Objectives (Annual Program P1an,^p, 42) 
The Department implemented' a "discrepancy" analysis, relating current 
student performance levels to the statewide educational goals, as a means 
of establishing needs to which education -programs should be addressed, 
Educatibnal priorities for FY 1977 were established. 

Documentation . . ' 

. ' Between' 1970 and: 1972, the New Jersey State Board of Education con- 

■ •• • • ^ ■ -f ■ . . 

ducted an "Our Schools" project, a needs assessment involving broad 
citizen participation to arrive at a sot of formalized statewide goals 
for public education. The goals were adopted by the state board on 
April 12, 1972, ^nd have'represented since then the basic educational 
priorities for the State, the Title IV-C Program is directed as well to 
these goals. 
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The New Jersey educational priorities for FY 1976 derived from an 
• analysis of the discrepancy between goals and assessment data. This 
> analysis, together with the goals ^nd assessment data, Ve found in - 
Appendix IV-C-1 (pp. 43-64). The assessment 'data- base is the same as 
that used in FY 1976 but is updated through trend analysis by the Depart- 
. ment of Educa-tton. ■ ^-^^ ..y*^ ■ j 

The Title IV Advisory Council reviewed and real^irmed the critical 
. -priorities and added a requirement that a basic skills RFP be develpped / 
to solicit. propo'saTs in 'the area of mathematics skills jdevelopment 
(IV-C-1, p. 65). . 

The. New Jersey Guidelineslfor Title IV-C, distributed to all dis- 
/ tricts, incorporated^^e priprity areas for educftlpnal development 1n 
the' State, lis ted:. ?ire six "critical " priorities and four additional 
"important" ones. Four of the ten represent distinct urban needs; four 
others represent both urban and non-urban educational needs >( IV-C-2) . ^ 
Two organizational priorities were established Vor the Department of 
Education: v ' 

, ■4- ■ ■■ 

a; pecentralizatfon to improve ser\^1ce and ensure "thorough 
and efffcient:;'' / 

b) Reorganization of Qepartment of Education to ensure service 
(IV-C-1, p. 68). , 

i- ■ ■ ■ 

2. Development of Part C Application Component (Annual Program . 
Plan, p. 69) 

Guidelines w.ill be designed to move districts toward the critical 
educational needs of the StJ^e. 

*k ■ 
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Both the Title JVj-C, Guidelines and the Program 'Announcement, provided- 
direction for the development efforts to bfe supported, by IV-C. Two Pro- • 
gram, AnpGuncem^^nts^w^ districts during FY 1977. The first 

(IV-C-3) uied the Request for Proposals (RFP) process to move districts to 
ci^ldress the'need fpr validated programs i,h the area of basic skills mathematy 

Because an insufficient number of fundable proposals was submitted in- 
response to the first Program Announcement, the State rAdvisory Council 
requested ^the Department to reopen the application period. This exceptional 
circuinstance was authorized by the U.S. Office of Education (IV-B-9). 

A second Program Announcement (IV-C-4)'in the Spring of 1977 contained 
•an RFP for supplemental center ser^yices on a multi-district basis. All ' 
applications were rated according to the^gree to which they addressed 
State priorities. Appendix IV-.G-5 contains a des-cription of the newly 
selected projects and the priority of 3acha<l dressed. Table IV-1 presents 
a synopsis of the priorities of new projects. \^y^ 

3. Equitable D>str4bution of Funds^ Among^ LEAs (Annual Program Plan, 
p. 68) "Ti 

Technical assistance will be provided to all districts requesting it. 

Documentation ' , . 

Technical assistance was provided to all districts requesting it before 
applications were submitted for review. A series ^f works hops^^was held in 
fou sites to help district staff decide if their-^ldea was appropriate for 
Part C support. An additional session vyas provided during each workshop 
to . assist applicant districts in stating their^ ideas as clearly-^as possible. 
Districts were encouraged to send a draft of their proposals to the IV-C - 



TABLE IV-1 

isi s ' drf 'Pr 



Addressed by New Projects 



Priority Area . 

. Basic , Ski l is / 
>, Social Relationsliips 

Producer/Consumer 

Health 

Basjtg Information 
, Citizehyhip 
Family Life 
Creativity 
Learning Process 
Ethics' 
Self -Worth 
T&E* 



ft . 



Priori ty 
• Rank 



' 1 
2 
3 



■ Number of New Projects 
Addressing Pri'ority 




5 

" 6 

f 

r 8 
9 
10 
11 



5 

2 ' 
2 

Q 
5 

1 ; 

0 

1 

2 
0 
0 

2 



TOTAL 20 



T&E is not a priority in the same sense as the others but is an 
overall mechanism' for school improvement activities, v 

*^The fourteen projects addressed more than one priority. 
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Project Center prior to t^e workshop so ttiat- t|>e)t,a)uld be cri tiqued. 

.■stai<?'(ysed fqrfns to, rate each draft for clarity and cbn- 
sistency (IV-Cr6)v - Follow-up -assistance was provided to all districts 
wishing |;ielp in preparing subsuquint drafts. 



. A. Review and Approval of Proposals' (Annual Program Plan, p. 69) 
Three or more, experts from outside the Department will review and 
critiqueeach application and make recommendations for or against its 
approval. Those recommendations will then be reviewed by the State. Advi- 
sory Council and forw^^rded to the Chief State SchobY Off icer. The LEA 
and non-public schools wiliybe notified of the Council's action; if 'favor- 

able, the terms of the grant will be implemented. 

* * ■ * i ■ . ■' ■ . , 

^ Documenta tion . 1, ,s 

"■Reviewers from oQtside the Department were chosen on the basis of 
broad- educational background which included (1) familiarity with current 
programs and needs in a wide" variety Of content areas, at, all levels of 
•the K- 12 system; .(2) knowledge of the development Process used by the 
Department; /(3) "ability to analyze written information agaipst established 
criteria; and' (4) the variety of viewpoints they bring to the selection 
process (e.g., curriculum development, teacher preparation or school man- 
agement). In addition, reviewers of validation applications we|fe familiar 
with evaluation procedures and instruments. A Synopsis of the ^ckground 
of a sample of this year's outside reviewers appears in Appendix IV-C-7. 
The review and approval process was conducted in five steps: 
^) Preliminary Selection . The Stage I review group was composed of 
reviewers from ou1^4de the Department, all of whom backgrounds 
in the fields of ve^ucatio-n. Stage I reviewers were III ven a descript^'bn of 
• ■ 4'^' ■ IV-7- ■ . ^ 



the oyerall revievi prcrcTess and the forms used for the review (IV-C-8). 
Twd types of information on each project resulted from the Stage I review 
a numerical rating representing a reviewer's judgment of the quality of 
the Idea described; and a Reviewer's decision to either consider the 
project further^or drop It from competition (IV-C-9). 

b) Formal Selection for Funding , The Stage II review process'' 
which Included members of the State Advisory QounclTTT described In 
Appendix IV-C-9. As a result of reviews during Stage II, fourteen new 
applications were recommended for funding. 

c) ' Recommehdinq Applications to the Selection Subcommittee of the 
State Advisoxy Council . All applications and reviewers' comments were 
available for review. Staff members were queried as to the outside 
reviewers' assessment of specific applications. A synopsis of each proj- 
ect along with information on rankings and th^ rationale and conditions 
'for support was prepared for the Advisory Council. Based oh this informa- 
. tion, the Subcommittee recommended approval to the full Advisory Council 

of the Stage II recommendations. 

d) Advisory Council Approval . The full Advisory Counci 1 reviewed 
£fnd approved the selections in accordance with established priorities/. 

e) Commissioner Approval . The final list was sent to the Commis- 
sioner who accepted the Council's recommendations. 

5. Privdce Non-Prof it School Participation (Annual Program Plan, 
p. 71) 

Private non-profit schools are expected to participate either by sub- 
mitting their own appl ications^rough the public schools; or by becoming 
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Involved cooperatively with the public schools In a problem they both 
have Identified, In accordelnce with Section 406 bf the Act. 

• Each LEA receiving IV-S funds will provide for equitable,; 
effective participation by children enrolled In private 
schools In the area It served. . v 

• Each LEA application under Title IV-C will Include Informa- 
• ^ tlon on the number of private schools in the area the proj- 
ect will serve; how representatives for those schools 
participated In developing the proposal; and the Information 
to assure that equitable services are provided. 

./ ' 

Documentation 

As part of its program plan for each year, each district was required 
to document that non-^publlc schools were asked to participate In the proj- 
ect and hdw they will be Involved. Appendix IV-C-3 (p. 3) is th? sectjon 
from the 1975-76 program plan which requires this information. 

As part of the plan,^ districts were required to specify the number of 
public and private school children to be included in field test activities 
(IV-C-10). To date, -all private schools wishing to participate in Title IV-C 
funded projects have been able to do so. 

Appendix IV-C-11 provides sample correspondence between project devel- 
opers or project directors and non-public school administrators, and vice- 
versa, documenting the invitations extended to non-public school personnel. 

' One hundred eighty-seven (187) applications were received in response 
to the. two grant solicitations during F^Y 197/, Of that number, fifty-eight 
districts had no non-public schools within their geographic region. Of the 
remaining 129, sixty-six (51 percent) applications presented documentation 
oi^ their efforts to include non-public schools in the planning of their 
pi4|j|f0osals. One project application was initiated solely by a non-public 
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school. Ea^h of the fourteen funded districts had accommodated the appro- 
priate non-puhllc schools in the development of the proposal (IV-C-12). 

6. Proceclures- for Evaluating Projects (Annual Program^^^ 
Individual: project effectiveness will be determined by on-site evalua- 
tion methods conducted by the State. Annual on-site evaluations will be 
conducted bj/ an outside impartial observer. Quafified independent on-site 
evaluators^will be usedvto determine project effectiveness. 

Documentation 

To receive continuing funding for a second or third year develppment 
or dissemination project, districts with Title IV-C grants must provide 
information showing that progress toward accomplishment of objectives is 

■ V w : 

being made- This information, accompanying the application for cpntinua- 
tion funding, was given serious review.as a basis for approval. 

During FY 1977, fifty-six Title IV-C projects were under way and 
applied f-or development or dissemination continuation in FY 1978'. On-site 
evaluations were conducted during the yegr, using thirty^three on-site 
evaluation specialists. . ^ 

Of the thirty-three consultants used, fourteen were classified as research 
or evaluation specialists and nineteen were subject matter specialists. 

The thirty- three evaluation specialists were drawn in largest numbers 
from the universities (42 percent); eight came from public schools (24 per- 
cent), .The remainder were predominantly private consultants. 

It should be noted that projects seeking validation receive on-site 
evaluation visits, the reports of which are used in liei^of the New Jersey" 
systenf outlined above. Those projects which have completed development 
and are not eligible for validation are not visited. 

' \ IV-10 , , 
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. A copy of the "Manual for On-S1te Evaluators," Including the method 
for rating projects and a copy of thie .Project Evaluation Report usfed, are 
Included.as Appendix lV-C-13 and C-14. 

On-site evaluations of development projects were completed by the first 
week In April. By the second week In April, copies of these evaluations 
were available to the project directors. On-site evaluations for dissemina- 
tion projects were completed by the first week In May and reports were made 
avatlable to the process consultants by May 15. The reports were reviewed 
by jjOth parties for possible Incorporation of recommendations Into the folloi 
ing year's proposal (IV-C-15). Sample end-of-year reports containing fevalua 
tion data are included in Appendix iV-C-16. 

7. On-Site Monitoring of Local Projects (Annual Program Plan, 
pp- 75 and 21) . 

A State Department representative will visit each project at 1e.ast 
three times a year to assure that the project is on schedule and perform- 
ing as described. 

Documentation . 

Appendix IV-C-17 contains samples of visitation logs maintained by the 
process consultants. The logs contain information on project personnel 
visited, reasons for visit, problems discussed, actions taken and a rating 
of the progress the project is making in accordance with the approved 
project plan. ^ 

The visitation logs indicate that projects are visited at least three 
times a year and that the visits often result in the resolution of problems 
such as time delays, scheduling and inadequate project planning. 

IV-ll 
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8- Local Project ' Evaluatiion by LEAs (Annual Prag^im Plan, p; 77) 
All Title IV-C planis wilV r^^jire an evaluation. 

Documentation 

Project evaluation criteria developed by the State Department of "Educa- 
tion for submission by local distriits are found in Appendix IV-C-18. The 
criteria cover such elements as scope, relevance, flexibility, feasibility, 
reliability, objectivity, representativeness, timeliness, pervasiveness, 
ethical considerations, and protocol. Each element is defined by severa?! 
questions with appropriate scales. 

9. technical Assistance to LEAs^ (Annual Program Plan, p. 78) 

During project development, assistance will be provided by EICs* and 

SEA staff, in the form of workshops and individual consultation, V 

' ■ ... ' ■ 

Documentation " 

The Project Center was staffed to provide technical assistance to ^ 

projects in five areas: planning, evaluation, materials development, 

program implementation, and ^ ^pni nation strategies. The procedures 

I 

used to provide technical assistance were similar to" those used in class- 
rooms where teachers provide iHLdivj^ualized instruction. At the beginning 
of their development of disseminatfon stages, projects were brought together 
for group presentations of information perti^pnt to all of ttiem. The last 



* 

As used in this Report, the Educational Improvement Centers (EICs) refer 
to the State-managed intermediate unit supported with State aid and other 
administrative funds. On occasion, school districts will apply for funds 
under the Supplemental Center category and "attach" these projects to the 
EIC. EICs also received Title IV-C, Strengthening SEA funds and administra- 
tive funds during FY 1977 to perform the technical assistance activities 
described in this Section. 

#. 
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part of these sessions consisted of Individual conferences., where , the 
needs and problems of the Individual projects were discussed and next 
steps were determined. 

Technical assistance thereafter was mostly provided on a pro'ject-by- 
project basis, depfending on the'need^ of each project. Staff members , ; 
assigned to eacj) project as process consultants, provided assistance during 
project ^lementation ^d were responsible for seeing that the projects to 



which they ^ere ass igned^N^ceived other forms of assi&^ance a*S needed. The 

group meetings held during thi s past year included /h introductory session 

' .. . I ' , 

for newly selected projects,' an introductory session for a>if^rojects 

approved for dissemination and a workshop on materials production for those 

validated projects which needed to prepare materials for- their dissemina- 

« 

tion programs. , 

Educational Improvement Centers (EIC), ijitermediate resource centers 
established by the Department to provide technical assis'tance to school 
districts, provided an additional resQyrce for assistance to projects. 
EICs most frequently gave assistance in the areas Sf program planning and 
design (examples: a training program foK. pr*bject staff on how to devel(;^;„,^ 
a curriculum, and training in project management techniques); locating 
background information (research reports, otKer programs in the same con- 
tent area); evaluation design and cpntent 4nforrT^tion- (particularly in the 
areas of special education, programs for the gifted, and individualization 
of instruction). 

10. State Leadership and Professional Staff Development Activities 
(Annual Program Plan, p. 9) 

As determined from experience, staff development was most needed in 

planning and implementation of field test activities. On-the-job training' 
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wa,s to be provided by teaming experienced with Inexperienced staff members. 
In addition, £he Department was to continue to provide a series of training 
session's on T&E, the comprehensive planning and evaluation process for all 
districts- ' ' w 

■* * - ■ '■•'*.''■', , 

Documentation 

The staff members with the least exper1en(?e are the process consultants; 
consequently rnqst of ttie staff training activities this year were directed 
toward this group: Much of the training occurred as part of the everyday 
work of the office/ Each project was assigned both a process consultant 
and a planner, who was experienced In working with projects through the 
planning, design, and field test stages. Problems. and decisions regarding 
projects were discusser! jointl y so t h a lr^process consultants would become 
familiar with federal regulations and state procedures and with techniques 
which have proven effective in the past for solving particular problems. 

. A formal training session for process consultants was held In June. 
The training session, conducted by a consulting firm which had worked with 
a number of Title III projects in the past, focused on project management. 
The session served a dual purpose: process consultants learned about 
management techniques and problems, and in {urn taught project directors 

* J 

the techniques they had learned (IV-C-19).* 

•> 

il. In-Service Training for LEA Staff (Annual ' Program Plan, p. 79) 
Training needs among LEAs, assessed from previous years, will include 
understanding and skills in research, evaluation and planning, and imple- 
menting strategies. , , 
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Documentation ' ^ 'j 

,Muth:,Qf the training provided tp LEAs took place; as part of the 
technical aAlstance provided to districts. 

^ A more *rma1 tr^ning workshop which- focused on project management, 
however. tppK place in FY 1977. Host of, the participants were directors 
of projects in their first ye^r or other people who would benefit from 
the. training. Approximately twenty district people were trained. The 
training sessions were led by the process consultants with assistance from 
outside consultants. In future years, the process consultants will be 
able to "conduct this training session for new project staff, on their own. 
The agenda for this training program is given in Appendix IV-C-19. 

In January, 1977, 'the second annual Educational Develppment Conference 
wa.s held.. All proj.ect directors werp Invited to attend a series of work- 
shops on such topics as the'National DiffusiPn Network, Local and State 
Program Evaluation, and T&E Update. Validated projects were recognized. 
Presentations were made by Dr. Thomas Burns, Associate Commissioner for 
State and Local Educational Programs and Dr. Fred G. Burke, Commissioner. 



1?. Provisions for Continuing or Terminating Projects- (Annual Program 
^ Plan, pp. 81-2) " 



\ Continuation plans will be reviewed for approval or\possib1e termina- 
tion on the basis of on-site' evaluatoV or expeditor repolhts. 

Documentation . , * 

Of projects in their. first or second year which submitted continua- 
tion proposals for FY 1977, five were terminated' Four were development 
projects, while one was in dissemination. Reasons for termination included 



IV-15 



ERIC ^ 



falling to meet objectYves or, in tfTS^case of the ci1ssem1nat1on pnpjectj 
a falling .off of demand for the project. ^ , 

Between 1972 cjnd 1976, twenty-nine, projects were tenninated whe,n; '. 
they did not meet, or were^ considered not likely to be able to meet, 
their specified 'goals and' objectives. ^ , . 

Consideration^ in whether or not to approve, a continuation plan 
included: ^ /, ' , - 

• The reasonableness of the time frame, e.g., was it possible 
'to show results if the time required actually to introduce 

and implement the' project in its ftrst year was inadequate? 
^ ^ In this case, however, was project implementation on schedule? 

• ^ The possibility that goals and objectives can be met in a sub- 
^sequent year if specified changes in program design are made 

• Are fiscal procedures sound? 

13. Ratio of Funding Between Development and Dissemination~ ~(Annual 
Program Plan, pp. 89-90) 

It is anticipated that one-third of the available funds will be needed 

for development and two-thirds for dissemination. 



Documentation ^ ' 

Of the $^,273,058 expended in FY 1977, 43 percent was spent on develop 
ment projects and 57 percent was spent on dissemination projects., 

14. Assurance ^ Fumi Distribution (Annual Program Plan, p. 91) 

Funds under Part C will be distributed equitably among local agencies 

on a competitive basis, with assistance ^given to those LEAs less able to 

compete because of size or local financial resources. 
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' Documentation . • i - 

•An distrkts were given full opportunity to compete for Title* IV-C , 

r ■ ■. . . •■ ■ ' , '■ , 

funds. .■Apnoancements of the compfetitibn Were distributed to all districts; 
workshops were conducted to stimulate participation and provide instruction 
in completing applications; and technical assistance was pro vi (Jed on "an 
individualized basis, both before submission. of applications and. after 
their receipt,. to assist in building up their quality and competitiveness. 
(•5ee documentation for" Equitable Distribution "of Funds Among LEAs^. p. IV-5, 
above. ) 

'Idence that assistance provided by the Department is' having a posi- 
tive effect on the, distribution of funds is provided by an analysis of 
the awards made during FY 1977. Half of the funds distributed went to 
projects inpoorer districts (IV-C-22). Of the twenty-eight urban aid 
cities, ten were awarded grants. -(Fourteen of the thirty-five development 
projects funded were in these ten -districts (IV-C-23). , - . .' 

5. Criteria for Fund Distribution (Annual Program Plan, p. 92) 
Tfjfe major criteria used in judging IV-C applications will be distri- 
wlth the applications to the local districts. - 




Documentation^ ' ; . 

A publication entitled "Guidelines for ESE'A/ Title IV, Part G, 
Public Law 93-380, The Amendments of 1974 to the Elementary and Secondary 
Education Act, 1976-77" was distributed along with applications to. all * 
districts. The criterV for judging applications appeared as Appendix D 
to that publication (IV-C-2). 
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16,, Provision oiF Technical Services (Annual Program Plan, p. 93) 

' . The State and EICs will reinforce and extend local -capabili ty to 
'i- • ■. .. "f • 

initiate innovative and exemplary programs and activities through meetings;. 

' ' ' /-^ . " ■ • • • 

workshops, conferences, and published materials . ' 

Documentation / 

fJrov1s1on of\ technical services permeated the entire New Jersey ^ 

process .disslgned for Title IV-C. 

• Technical assistance was employed to encourage and prepare . 
districts to Initiate applications for IV-C funds. (See. 
Equitable , Distribution , of Funds Among LEAs, p. IV-5, above.) 



t 



Guidelines were published ahd disseminated to prcJVide 
instructions , for applying the criteria by whicf> applications 
would be judged (IV-C-2). 



During project development, assistance was provided by EICs 
^Pnd SEA staff in the form of workshops and individual con- 
sultation. (See lechnical Assistance to LEA3. p. ♦V.-12, 
above. ) . . : 

• In-service training, panicularly in management of IV-C^ 
projects, was conducted for LEAs. (See In-Service Training 
for LEA Staff , p. IV-14, above.) " '. 

• Dissemination activities included publication of manuals 
for ten validated projects; publication of numerous feature 
articles in Interact (IVr-C-24) and statewide and national 
distribution of some twelve thousand copies of Educational 
Projects That Work (Appendix IV-C-25). This information 

is based only on a report of dissemination activities for 
July to December, 1976. Information for the last half of/ 
- the fiscal year remains to be accumulated and published 
in report form. 



17. Identification ajid Validation of Proven Practices (Annual Program 
. ^ Plan, p. 94-5) . ~ ~" ' 

Through development of an evaluationsdesign that will yield statistical ' 

* ,- 

results; monitoring by staff three times yearly; visits by'tratned evaluatdrs; 

' • ■ . ■ .'' 
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and a final year-end report, the state will 1dent1fywpract1ces and pro- 
■grams that work, are cost-effective, andl are exportable. , v , 

Projects that are validated as successful , cost effective, and export- 
able are nominated for validation by .the USOE Dissemination Review Panel, 
by the State's IVD (Identification, Validation and Dissemination) process, 
and/or other appropriate validating groups. 

Documentation • 

A table, listing for FY 1^77 the number of projects completing develop- 
ment ^nd the number successfully completing the IVD process, appearlVs 
Appendix IV-C-26. No national validations were achieved during FY 1977. 
five were validated through the State IVD process. Since 1973, thirty 
projects have been validated through the State process, with ten of those 
also validated at the national level. 

•18. Provisions for pjissemination (Annual Prognam Plan, ^p. 95) 
The State will transfer locally validated projects to impact more 
widely through its statewide dissemination program. To aid in dissemina- 
tion, the State and its ElCs will give meiterials, training, and-,technical 
assistance to potentiaT adopters. 

Documentation 

Appendix IV-C-27 presents a table showing, by project (up to the end 
of calendar year 1976), its validation status, whether statewide t(IVD) 
ornatidnal (JRDP). In addition it shows by project the mpdel by which 

r 

consumer adoption was facilitated. 

The consumer adoption models used (in some instances, more than one 
model was used) toLaid dissemination were as follows:' 
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. Producer-consumer'' ' . 11 

Commercial distribution r 1 
Turnkey distribution 10 
■ National Diffusion Network , 10 ..' ' ' r 

Each prbject had an individual plan based on the foregoing models usually 
Involving training, awareness, involvement^ and other elements. 

. 19. Evaluation of Statewide Dissemination Efforts (Annual Program 
Plan, pp. 99-100) ~ 

Information for evaluation of the sta'tewide dissemination plan wilj 

be acquired. 

V , . " ■ ■ ■. 

Documentation 

Appendix- IV-C-28 shows for the first half of FY 1977, by project, the 
number of adoptions in New Jersey and other states and the number of turn- 
key trainers trained in New Jersey a/id other states. Of nineteen projects- 
ready for. dissemination, twelve were adopted in other New Jersey districts. 
Of eighty-eight adoptions. Project ACTIVE alone was adopted in as many as 
thirty-two districts. Eight of the projects were adopted by other states 
(a total of 129 adoptions). The Institute for Political and Legal Educa- 
tion Project was adopted or adapted in sixty districts in other states. 
Thirty-nine turnkey trainers were trained for nine' projects in New Jersey, 
and twenty-four for other states. In the past four years, these New Jersey 
validated projects have been dissaninated to 727 districts. Approximately 
two- thirds of all New Jersey districts have adopted- at least one of these 
programs. 

20. State's Strategy to Encourage Adoptions (Annual Program Plan, ' 
p. 100) * . , . 
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, f yJthe state win conduct workshops on! dfevejppment. where 

"^^^^ be gtVW:to^€Oht1nuat1ort of IpmpTeted. 

. .^wC PWjects at the developing district artd to sub- 
; \s€^^ d1sseni1nat1(5n to'x),ther districts...; 

• The state win prepare and .distribute a-cats^^^ 

Suiqf'essiFul programs that have statewide dls^fteml nation . 
' V pliairls and'pliace materials. on these programs W 

and in teacher; training col 1 eges . ^ ^| ^ CI . ' 



Dpcumentatlon j • 
. , Tby*6ug)i workshops and other dlssemlnationfactlvltl'^, of eighty-two ; 
projects _^wh1c>||jcompleted development between 1972 and 1977-- seventy-nine ■ 
were contlnued^t 'the local level with the district's -own funds. 

The State took^ultiple opportuDi ties to introduce the concept of 
dissemination in, connection with^Titlp IV-C. At the initial workshop 
dealing with the s^Vectloh .process for the program, dissemination was 
discussed as part of tfiife. intent of the legislation and a valued end- 

product in awarding! the grant. Disserftination Is further reinforced at 

' . \ : '■■ : • ■ ' 

introductory sessions fornewly selected projects and as a significant. 

o ♦ 

element- in the yearly on-site evaluations. 

During the year, an Educational Development Conference was conducted 

. . J ' ■ ■ 

V ^ 

at which al r newly val 1dated.: f)roject:s were honored. All districts were 
Invited and their represerftclti ves became aware of the projects in terms 
of their potential . value for . themselves. / ^-^--^^^^ 

As a means of encouragiVi^V adoptions of validated projects, the State 
published information about Kt?- validated projects in a document entitled 
Educational Programs That Wb| ^k, a catalog' of demonstration sites of suc- 



cessful education programs (|y-C-25). Section I of ttie publication 



•describes twenty-eight successful programs whose staffs offer^omplete 
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dissemination services "and materials to interested educators. Section II 
describes an additional three successful programs whose materials may be 
ordered. Section III describes eleven nationally validated projects 
developed in ether states and implemented in Ney/ Jersey. 

In addition, information about successful proyrams has been placed 
in numerous locations, to reach toachers , administrators, and the public 
(IV-C-29). 

While not specifically projected in the Annual Program Plan, the 
State developed during this fiscal year a series of publications to' aid 
districts in development or to advance adoption of validated projects. 
They are listed below. 

1. Guidelines for Writing Manuals 

2. Dissem ination Applicati ons 1976^77 

3. Educational Programs Tfiat Work 

4 . Manua l for Project Administration 

5- Gj^n' ^el ine s and Foj^ms for Preparing tlie 19^7 Pjlf^iUiani Plan 

C. ASSESSMENT OF TflE PROCESS 

■ An analysis of the process used by the Oepardnent of Education in its 
administration of the Title IV-C Program indicates tliat recjui renionts were 
met in an (»xeiM[)liiry fashion. 

The data on whirh |)r iDri ti (m, are t^' ^abl i shed is u|)dated <incl tlie 
Advisory Council reaffirms fnniiirui [)r iori ti es . Tht^ t^s tal) 1 i stmuMi t oT an 
KFP for math was an indication that the Council Wc\s respontling to new 
information. « 



The reopening of the appljcration period during the Spring of 1977 was 
not in violation of the single application requirement of the legislation. 
A federal' directive from the U.S. Office of Education found such a reopen- 
ing to be permissible as long as there was sufficient time remaining for 
the expenditure of the funds at the local level and the funds were made 
available to all districts on a competitive basis. The Department was 
in compliance with both requirements in its reopening of grant competi- 
tion, and, in doing so, was able to extend funding to more projects. 

Technical assistance services continue to be of good quantity andTV^y^ 
quality. The, Department uses a multi-method approach so as to addresi 
group and irjdividual district needs. That the number of project appl i\- 
tions grew in. FY 1977 to 187 from 111 in FY 1976, is in part an indication 
of the encouragement and assistance provided by the Department to local 
districts. 

■ The proposal review process appears sound and complete.' The use of 

external reviewer?, while not required by federal guidelines, provides a \ 

more impartial rating from carefully chosen experts. The involvement of 

State Advisory Council members in the review process also appears to be 

a commendable activity. By having the SAC members participate in the 

review process, the Department insures a joint decision-making pr^o^ss 

and facilitates the , formal review process undertak6n by the full Advisory 

Council. 

Efforts by the Department to direct funds to poorer distt-icts, while 
still maintaining the competitive naturt^ of the granting |)rocess, have 
resulted in a higher- concentration of funds in those districts than in 
wealthier, more able districts. 
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The use of a variety of incentives - from awareness information to 
awards and commendations - appears to result 1n an above average ratio 
of validated projects to the total number of development projects funded.. 
Such activities as the Educational Development Conference are instrumental 
in maintaining New Jersey's status as a prime contributor to the pool of 
nationally validated projects. In addition to contributing to the national 
pool, the State uses its own IVD process to identify exemplary programs 
for dissemination to districts within the State. 

In one instance, thfe Department's actions appear to be insufficient 
to meet the spirit of the legislation and the specific requirements af 
its own Title IV-C application process. Nearly half (49 percent) of the^ 
IV^C proposals submitted failed to provide documentation of efforts to 
include non-public, schools in the planning of the proposal. . All funded 
proposals did provide such documentation. 

Although the project application requires that documentation of an 
invitation to non-publTc schools be appended to the application, many 
districts neglected to submit such documentation. This was the case 
despite the fact that a statement of assurances (one of which related to 
non-public school involvement) was signed by the local school superin- 
tendent. ^ 

Of the fourteen proposals funded by the Department, however, all 
provided evidence of having accommodated the appropriate non-public 
schools in planning the proposal. Thus, the Department is not support- 
ing projects which are in non-compliance with the requirements. 

In the process of analyzing evidence that the Department fulfil ledV 
process requirements of the Annual Program Plan, a small number of 



observations were made which merit attention in addressing the require- 
ments- of subsequent years. Some of these observations were made in the 
FY 1976 evaluation report.^ 

1) Data Collection .. The State Advisory Council Evaluation is 
designed as essentially an audit of Department-collected data. In some 
few instances, data collection content or format were changed, or specific 
data were not collected. Such changes make it difficult to build a longi- 
tudinal data base which is critical to the assessiiifent of a Program such 

as Ii*le ^V. Examples of such data are Appendices IV-C-5D, IV-C-8, 
IV-C-12A,IV-C-17Bi and IV-C-17C in the FY 1976 Report.^ - ' 

2) Reports to the Of^f ice of Education . New Jersey ' s val idated 
projects are still not being entered into the ERIC system. It would appear 
that this problem might be alleviated soon, since a Inational file for 
educational programs and practices is to be designed! and implemented within 
the next year. Such a file-would be comprised of projects such as those 
developed and validated in New Jersey. 

D.- ASSESSMENT OF OUTCOMFS AND IMPACT 

1. Projects will be continued with local funds^.. once Title 
funding concludes (Annual Program Plan, p. 22Tr~ 

Documentation 

A table showinq, by fiscal year-, the number of projects continued 
with local fundi/g appears on page IV-26. Over the five years (1972-76) 

^-^tcLtewuu/t^ o( F.S.F.A. TJtle IV in Nt>w Jt^rsoy for Hi seal / 

Year 1976, education and Publ ic Af fa irs ,' September 30," 1976. ~~ 

'^Ibid. 
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for which data were available, 82 projects completed development and 79 
were continued. 



Title IV-C Development Projects Continued 
with Local Funds after End of Federal Funding 1 

■ " 

Validated- Non-Validated 
FY Continued Continued 

72 3 .a 

73 4 10 ^ 

74 9 16b) 

75 6 (3)d 12c 
.76 ■ ' ( 6 NA 
77 \ 5 8 

a) one continued with other -f^der^J funds ; one with non-Titifle IV-C 
state funds , '^MbMvSi 

b) two continued with non-^^'|l1i^f^C^ funds 

c) one continued with nop-Title ^V-C state funds 

d) (3) projects validated in FY 74; additional components validated 
later 



2. Projects which were disseminated by the State will be adopted 
Annual Program Plan, p. 22). ^ - 

Documentation - ' 

Of ninjeteen pr-ojects diissemi nated by the State in FY 1977, eighty- 
eight New Jersey districts and 129 out-of-Sjtate districts adopted them. 
Nearly complete information sliuws that appr:^)ximately 252,344 Now Jersey 
students and 6,939 teachers in New Jersey (duplicated counts) were affected 
by them (IV-C-30). Counting previoiri^yiars , a tot;al of 483 adoptions had 

taken place in New Jersey. 

\ } 



Student progress vyilj_ occur <}js a resu_Lt of a nj?w Tiil(^ IV-C 
p r-^e ct or "tTie proTect ITTp, imT^^T it/s' s taJ(H( "(]oaJs (AnTuhn ' 
Proriram Pfan, p. "22). -^^-^r--^'-^ 
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Documentation . . . 

Based on rigorous evaluation design, projects are judged as to 
.whether or not they have met the learning objectives initially established 
for them. When these objectives have been met, districts adopt them as 
part of tljeir regular educational programs. In addition, they may be 
validated either by a state designed process (IVD) or try a National Dif- 
fusion Network process. 

The following table shows by fiscal ^ear, the number of projects 
which completed development and the number validated by each process. 

Title "IV-C Projects Awarded Val 1dat1on 

FY Completed No. Validated" ^ No. Validated 
Development _ Uvn) (JPRR) 

72 . 9 3 . 2 

73 • ,n 9 5 

74 17 4 .3 

75 . 26 f 6 (3)a 2 (pending) \ 

76 — 6 NA ^ 
77. 13 ^ ^ " 

a) (3) projects validatek:in FY 19/4 but wore boiruj validated on 
additional components 



4- TJlLl JXl^ projects awarded, completed ajiid adopted in fiscal 

year 1976 wil 1 bQ_ related |o pjjori educational g oals" and 
objectives . 

nocu mentation ' 

During FY 1976, oT ninp [n-o/)(M:ts avviU^lod, over lialf wore in t:lu^ Lof) 

three priority areas. (See page iV-b of Lliis Report tor table t)t [)riori 
ties addressed by new projects.) 
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' 5. The Title IV-C project represented an innovative , cost- 
effective program in judgment of on-site evaluators and 
State Department of Education staff. ^ 

Documentation > * - 

Each project is given ratings by on-site evaluators fallowing site 
visits, for i nnovati veness , effect or impact, cost-effectiveness and 
exportability. Appendix IV-C-31 shows the ratings on these four variables 
as well as the mean ratings for all projects for each of the four variables. 
On a ?cale of 5, project averages were 2.52 for i nndvciti veness; 2.40 for 
effect; 2.62 for cost-effectiveness and 2.56 for exportability. 



The on-site evaluation was given heavy weight in the final decision 
to continue projects, but knowledge derived from monitors' reports and 
the Project Center's experience with the project played a significant part 
as wel 1 . 



E, IMPLICATIONS FOR FUTURE PLANNING 

The Title IV-C Program in New Jersey continues 'to be an exemplary state 
development effort. A substantial percent of funded projects continue to 
.be validated and adopted by other districts in {Jew Jersey and in the Country. 

Of the five reconiiiendations for strengthening the Program made in the 
FY 1976 evaluation, three appear to have been- addressed' in whole or in part 
during FY 1977. The reorganisation of the IV~C Program has helped to^ 
address the workload proble^iis which existed in FY 1976, Roles and responsi- 
bilities for all staff now are clearly defined and project review processes 
are on schedule. 
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The reorg^tAization of the IV-C Program also brought about a stronger 
conceptualization of the role that Title IV-C should play in T&E. This 
integration of IV-C and T&E in the Department is being carried -on down to 
the local level through the information conferences and workshops. 

The suggestion that the Department press the U.S. Office of Education 
to enter all New Jersey IV-C validated projects into the ERIC system in 
order to effect the widest possible dissemination was hot addressed during 
FY 1977. As was noted previously, however, a special national file is 
to be developed for programs and practices. Also, other dissemination ^ 
activities employed by New Jersey and the National Diffusion Networ^k 
appear to have been very successful in promoting adoptions and adaptations 
of the validated projects. 

The suggestion that the Department consider the possibility of proj- 
ect design activities involving producer and consumer districts concurrently, 
making adaptations as needed to meet the requirements of both, seems to 
have been accepted wholeheartedly by the Department. A speecf^ by Commis- 
sioner Burke ,at the Educational Development Conference in January ,^ ,197.7 
(lV-C-32), outlined the general features of a new development system based 
on this idea. The concept is presently being designed' by the Department's 



staff in Research), Planning and Evaluation. 

A recommendation relating to the continuation of detailed tracking 
of consumer districts in realizing achievement gains has not been addressed 
fully. Th^^area is likely to be ^f increasing Importance in the future. 

Final 1.^«*TT)e reconiiiendation for the development of cost accounting 
and cost-benefit approaches to Title IV-C projects has not been addressed 
by the Department. This area also is likely to be of great importance in 

IV-29 



' C) 



the future. It is possible, however, that progress ''in tj^his ar%a will 

• \ 

need to await advances in the use of such technology in the area of 

■< 

education. < ' s 

Based on this review of FY 1977 efforl^^^a^gl lowing .suggest 
are made for improving an already strong Program: * ^ 

1. Improve and standardize where possible the data requirements 
and the data collection formats developed during FY 1976 and 1977. Changes 
should be made only where benefits in information utility will be increased 
substantially. Additional data requirements and formats should be added 

to the basic design as new information needs are identified. * 

2. Establish a review procedure which checks all submitted 
applications for compliance with requirements regarding non-public 
school participation in planning and implementation of IV-C projec^§. 
An inexpensive clerical review process would provide sufficient review. 

J 3. Continue to track progress of consumer distri.G±s-i^n achieving 

statistitally significant gains for IV-C projects to match thcjse of pro- 
ducer districts In adopting the new program in the new setting. ' Studies ' 

)of the chi^ge process indicalfe th^t the prc^ of an 

innovation involves a complex set of changes over a long period of time. 

The lack of extensive study in this area could provide an opportunity for 

the New Jersey Department of Education to extend its leadership in the 

area of innovation. 

4. This samo'aroa of change (implementation) could also be 

addressed through continued pursuit of a joint dev^elopment process among^ 

several districts. The "lighthouse" concept of innovation 1s only one 

4 * , , 



IV-30 



ERIC 



alternative for facilitating improvement in educational programs and 
practices. This area, also, is one in which the experience of Depart- 
ment staff might be put to use in designing new directions in development. 



\ 
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SECTION V 




PROGRAM FOR STRENGTHENING LEADERSHIP RESOURCES 



STATE EDUCATION AGENCIES 





A. INTRODUCTION 



Y ... to stimulate and assist States in strengthening the 

leadership resources of their educational agencies, and 
to assist those agencies in the establishment and improve- 
. ment of programs to identify and meet the educational needs 
of the States. (ESEA, Title V, Part A. Sec. 501 (2)) 

The purposes of the Program for Strengthening the Leadership* Resources 
of State Education Agencies are stated best in the original legislative 
language established by Copgress in 1965. The statement conveys the broad 
mandate of the legislation - states should use the Program's resources to . 
stimulate new ventjures , to address priority needs and to strengthen leader- 
,ship resources. The Program is perhaps the most flexible of all grant 
programs administered by the U.S. Office of Education. 

This ^ction is concerned with those "strengthening" activities under- 
taken by the New Jersey Department of Education during FY 1977. This year 
was marked by a continuation and refinement of objectives and activities 
initiated during FY 1976, the first year in which the Strengthening SEA 
.Program was upder the Tit|e IV designation. Such continuation means that 
the major theme of the Prc^gram was the development and" implementation of a 
"thorough and efficient" system of education in New Jersey as mandated by 
the State legislature. T&E, initiated during FY 1976, made considerable 
progress during FY 1977 and the Strengthen i SEA Program was a major 
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resoOrce used to prepare processes, products, and services for the Depart- 

the Education Improvemeht Centers, the County Offices, and local 
school districts. 

The Annual Program' Plan for FY 1977 was addressed to six objectives 
in the ar^eas of planning and eval,uation, educational data information 
systems, dissemination,, educational finan^g, and assistance tQ;Jocal 
education agencies. Each of the objectives was directed; in whole or in 
pa*^t, to implementing a "thorough and efficient" system of education. 

This Section is organized around the five major areas. For each 
3^ea, adherence to the Annual Program Plan is assessed by reviewing 
documentation of the conduct or completion of projected activities. Al^, 
3n assessment of the process used to addr*ess the areas/objectives is made 
and an assessment of outcomes is presented. A separate section discusses 
implications for future planning in the five areas. 

Since the objectives established for FY 1977 are process oriented, 
the evaluation is primarily one of establishing that specific activities 
were undertaken and that those activities were of adequate scope and quality 
Because ultimate impact is difficult to measure - particularly with the 
long-v-ange development o|f a J&E educational system - tf^e focus is princi- 
pally op Tiiore proximate outcomes and indicators of accomplishment. 

.The evaluation of New Jersey's Strengthening SEA Program is .based 
on: 1) documents,describing accomplishments or activities; 2) products 
c|eveloped during FY 1977; and, 3) interviews with SEA staff engaged in 
activities supported by Title IV resources. A self-assessment instrument 
was prepared for use with all professional staff engaged in Strengthening 
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SEA activities. This instrument assisted in more uniform data collection' 
and focused attention on outcome and^ impact questions (SEA-1). The narrji- 
tive report that follows draws liberally on these data sources. 



B. ADHERENCE TO PLAN 
It 

1. Planning and Evaluation 

Tw(> major objectives were established in the area of planning and 
evaluation: 

• In order for the New Jersey State Department of Education 
(SEA) to accomplish its efforts to provide each child with 
a "thorough and efficient" (T&E) education, the SEA, during 
FY 1976, will identify those educational problems, issues 
and needs in the State related to the delivery of services 
essential for children to receive a quality education 

. (Annual Program Plan, p. 83). > 

• During FY 1976, the New Jersey SEA wilj develop; a plan for 
the delivery of services designed to'4ridge the "gaps" 
identified in 1 above through a system of intermediate 

• units (Annual Program Plan, pp. 83-4). ./ 

Documentation 

The objectives were focused on setting up a system of needs identifica- 
tio; nd on developing a plan for addressing /the identified needs. The 
context for these activities was T&E, the requirement that quality educa- 
tional services be provided to all children. 



During FY 1977, the Department established the Office of Planni 
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Research. Jhis Office was created as result Cf the macro-planning-priori ty 
management systenv: developed in FY 1976. The Office has as one of its major > 
objectives 'the des^jn of a planning system for Program and ^upiiorV Services 
to meet T&E needs (SEA-2). The intent is to make- such a system an integral • 
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part. Qf the planning processes^ used in the Department, particularly in 

those units responsible for 'serVices and activities related to T&E. 

' ' ■ " . ■ 

During FY 1977, severiiv pol icy papers and studies were completed. 
These activities were addreped to significant educational problems, or to 
the improvement of services f^ori students who were not being adequately 
served. Major papers were developed in moral/civic education, teenage 
unemployment, t^^levi'sion^ Vf^lence, ^atti tudinal development, and career 
^e.du(;:ation (^EA-3). • ^ \ 

A spepiai plancfiVg'pr:^ct wa^ established in early childhood educa- 
jtton ^(ECE). Policy^resteartn^apers were prepared in several areas related 
to the developmenrt of^new programs in ECE. 

'^^lij^^entifying/and. the need for services for . 

young children in New Jersey 

2) research iF^iro the effects of early educational inter- > 
ventlon 

3) models of disseminating research findings to early' 
^childhoo(^ educators 

4) issues in accreditation,;Of*.j:)roqrams and professionals 

5) exemplary programs in E^(SEA-4) 

The T&E legislation' placed heavy Responsibilities on theVOepartmont 
for pro\^idit>g support services to local school districts. This respfcnsi- 
bility is wtended to the County Offices and th^Educational Improvement 
Centers . » 4r 

The- County Offices havp tho rest)onsibi>l i ty for stniing that all sch\)ol 
and districts met^t the requj'rements for a thorough and efficient school 
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system pursuant to Taw and. regulations, 'in. fulfilling this role, they . 
serve as the regulatory arm of the Department.. The.^ounty Offices provide 
services to both the Department afnd^to'the local school districts within 
their respective areas. They asJist 1?he 'Off fee of Management . Information 
in collQctin^nd maintaining data which informs admiqistrative policy 
.and action with respect to T&E. . The County Offices assist local districts 
in interpreting mandates ar]d regulations , -particularly Jbhose requirements 
related to- T&E (SEA-5). Some specif ic aqtivi ties of C^nty Office person- 
nel with respect to X&E are: . 

1. Provide a5sistance and supervision to assigned local 
.schools and local school districts in the implementa- 
tion of educational proCe^s^plans, educational programs, 
and other operational standards requtfed ^y State 
statute, and regulations. - . - • 

2. Prepare and disseminate materials necessary for 1od?^1 
schools and school, districts in conducting a compre- 

; ' hensive evaluation program. * , 

' Y 3. Trarn school district administrators, supervisors, 

and coordinators in the program impifpvemenL, process. ^ 
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4. Plan with staff from target schooy/identified tjncfer 
the minimum standards program in>order to analyze the 
problem, causes, solutions foT^f ici encies in j^sic 
skills as steps- ifi'th^design of Improvement programs. 



5. Conduct. traininy-for , local school and school district 
leaders Teg^rdln^statdtory and policy standards a^ 
' procedures for (Maintaining a thorough and efficient t 

r system of Ibducation ^'StA"l): - . V 

' : > r ^ . , ■ ■ . ' ^' ■> 

While the County Office provfdes regulatory services related to T&E, 

i * . ' ^ ' ■' ' • ■ « ' 

'*the Educational Improvem^t Centers (EIC) ' provide a^broad ^sange of pro- 
gram development services to local districts in their regions. The 
• general, structure of the ElC^system was . completed in FY 1977 with the 
, establ ishment of a third and a^four^ Center. • • 



Much of FY;1977,was taken up with planning activities focused on 
developing both general and unique servicesjj^or the EICs, A major product 
of the effort was the RegionaV Needs Inventory conducted by the Division 
of Research, Planning, and Evaluation in conaboration with the Branch 
of Regional Services in the Division of School Programs, The report was 
bas^d on a suirvey of a sample of educators in every school district in 
the State. 

Thd' Inventory, revealed that there^was widespread agreement on the 
need 1n local schools and districts for additional technical assistance. 
Other high priority areas for EIC services w>re: 

1) basic skills, particularly mathematics and metric education 

2) planning, assessment and evaTuation systems • 

3) in-service training for teachers (SEA-6) - ■ 
The EICs have already begun to develop and offer services to address all 

or some of these needs, > > 

. , ■ ^' ■ - A 

2. Educational Data Information' Systems ' ' /^lic 

. ^ , . ■ . I' 

^ , One objective was established for educational data information systems 

• To improve the SEA's capacity to provide valid, reliable 
a^d timely d^ta to State, regional , and local educational 
- / planners (Annual Program Plan, p. 84). 

Documentation - 

•The major activity addressed to this objective during FY 1977 was 
the cpntinued development of the 'Operational Planning System (OPS) for 
the Department of Education. The major purpose of the OPS is to^.insur^ 
a thorough and efficient operation of the Department of Educajtiqn (SEA-1). 



The planning process wHI Include the Cjbunty Offices a*nd .the EICs as well. 
^The OPS, when fully operational, will provide information, accountability, 
and organizational development (SEA-7) 

The OPS is intended as the- mechanitsm for integrating major Department 
activities with T&E. Major components of the System are: 1) employee 
performance planning and appraisal; 2) quVterly planning and evaluation; 
3) Interagency implementation planning; and 4) a monthly reporting system.' 
The design for th.e development of the FY L978 Annual Operational Plan 
includes a specification of procedures, responsibilities^ and products. 
Other activities responding to this objective were the continuation of 
information systems development an^the preparation of statistical 
information for Department, regional and local use. In both areas, FY 1977 
efforts were built upon foundations developed in FY 1#76. . 

Informations systems development proceded through the implementation 
of standard operating procedures for collecting data from local education • 
agencies {SEA-8). Approved instruments for data collection were developed 
and used in FY 1977 (SEA-9). A Data Dictionary for giiiding all data col- 
lection was also completed duriri^g FY 1977 (S^A-IO). The Department also 
prepared several statistical reports during F\1977. These are contained 
in Appendix SEA-11. ' . 



3. Dissemination 

One objective was established in the area of dissemination: 

• Durihg FY 1977-> the New Jersey SEA wil^l^disseminate in ^ 
timely fashion information regarding SEA, intermediate Bfclf 
units, and LEA progress and efforts toward initial 
thorough and efficient implementation (Annual Program 
Plan, p. 85). ' ' " • ^ - 



Documentation ..-' , j\ ' ' 

During fV^ 1577, the Department published nine issues of the New Jersey 
Interact, the major mass communications vehicle for the SEA. Several » 
articles in the. FY 1977 issues provided educators and interested lay groups 
with information on the progress of implementing T&E. -Liaison to news- 
papers and radio and television stations was also maintained. 
.. - The September, 197 e^issues of Interact provided the complete text of 
the Public School Education Act of 1975 (Chapter 212), the T&E legislation. 
This was provided in response to public demand for specifics about the 
Law (SEA-12). Also included was an article dealing with the reactions of 
political and educational institutions to the Robinson vs. Cahill judicial 
ruling which resulted in the T&E legislation. 

The October, 1976 issue provided a brief bibliography of publications 
on T&E. The article described each publication and told of their avail- 
ability -td New Jersey residents (SEA-13). 

The November, 1976 Interact ' issue presented two articles on T&E. 
The first reported on the development by the State PTA of -guidel ines for 
Kfeal PTAs regarding involvement in. local T&E efforts. The second article 
presented a description of the activities of the West Morris Regional 
High School District in complying with T&E requirements {SEA-14). 

Questions and answers on major elements of the T&E pracess were 
presented in the December Interact . T&E was explained generally and 
specific terms (e.g., goal indicators, standards, and basic skills) were 
defined (SEA-15). , . 

. In January, 1977, the procedures established by the State PTA for 
local PTA organizations to follow in getting involved in the development 
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of local T&E processes were printed in Interact . Eight major steps 
were recommended (S^A-16).' ' . 

"T&E: The Law and the Citizen" was presented in the February Interact . 
The article, in both English and Spanish, was prepared by the Department 
and the New Jersey Congress of Parents and Teacfiers to help citizens under- 
stand the T&E process and the bepefiti>^it can produce. 

^ "Town Meeting 11" Was alsd announced in the February, 1977 issue. 
This was a public television program during which the Comnissioner and 
his staff answered questions from callers regarding T&E (SEA-17). A first 
town meeting had been held in February, 1976. 

A two-page centerfold in the March Interact was devoted to a descrip- 
tion of the activities and services of the EICs. The presentation was in 
question and answer form and explained how EICs helped LEAs addres§ program 
improvement n^eds. Also in March, questions regarding minimum standards 
-set by the State as an outcome of the Educational Assessment Program were/ 
answered (SEAt18). ' " 

Commissioner Burke expressed his optimism regarding the State's 
progress in implementing T&E in^the April issue of Interact . The comments 
were made during Dr. Burke's appearance before the legislature's Joint ' 
Appropriation Committee in March, 1977 (SEA-19). 

The entire May/June, 1977 Interact is devoted to T&E. Major articles 
included ^on T&E priorities, a T&E calendar for 1977-78, minimal standards 
test results, and needs assessment (SEA-20). Me issue will be part of 
the training package developed- for the CorT|vbcation of School Executive 
Academy members (SEA-1). * 

. ' ■ 87 



News releases prepared by the Department were directed at improving 
communication wi^th the^general p'ublic, clarifying Department policy and 
actions/ Appendix SEA%i'|^^ samples of isuch releases. 

4. Educational Financing 

One objective was established in the area^of Wlucational financing: ' 

• For FY 1977, the New Jersey SEA will strengthen its internal 
management and financial operations as well as to provide 
fiscal/auditing assistance to LEAs as> evidenced by an annual 
financial report submitted to the Commissioner (Annual' 
Program Plan, p. 85). ^ 

Documentation 

Both new aiid continuing activities were undertaK^in FY 1977 to ^ 
address this^ objective. Major activities related to: 1) internal SEA 
fiscal management; 2) auditing; 3) grants management; and, 4) program 
budgeting. 

The accounting systert employed by the Department was redesigned 
during FY 1977 to enable the SEA to utilize Department' funds more effi- 
ciently. *A series of eighteen monthly reports is produced by the account 
ing system. These reports assist Division and project managers to main^^ 
ta^'n tight fiscal controls and to pl^n expenditures .(SEA-22). 

Monthly reports prepared by the Chief Auditor document the nature 
and extent of auditing activities during FY 1977. Services were provided 
in auditing and evaluations, ESEA inspection reports^ monitoring services 
and assistance, accounting and payroll conversions^ and rejquested reviews 
Othfer routine activities cbnducted were: 1) |*eviawing local school 



distr-ict. audits; 2) preparing Annual Financial Reports; 3). reco^rding and 
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, acknowledging receipt of all reports; 4) compiling financial and. statistical 
Information for the Commissioner's Annual Report; 5) reviewing accounting 
and procedural manual^ for changes required by action of the State Board ' 
and, legislature; and, &) reviewing reporting forms annually for changes ' 
needed before printing ahd^distribution (SEA-23). 

- , The Bureau of Grants Management provides overall fiscal management 
for grant resources. During FY 1977 it: ■ 1) provided analyses of new, 
existing, and pending federal legislation; '2) p.romoted utilization of 
federal resources to coordinate, strengthen, and Suf)port educational ' 
prior^i ties; and, 3) reviewed all non-state contracts and grants to insure 
fiscal soundness and compliance with federal and state regulations. Ttie 
Bureau monjjtored federal legislation and education reports and informed 
relevant SEA staff of pertinent inforrtiation. It provided assistance to' 
all., SEA staff in proposal development and review, seeking to avoid duplica- 
tion and foster cooperation with the agency, A resource cen-^er on federal 
educational laws was also maintained (SEA"24)..> 

During FY,i977, actiyities•-we^e continued in assisting districts to 
develop and implement program budgeting systems. T&E legislation and 
regulations require such systems to be iitipiemented during the development 
of the T&E planning process.'^ Pilot activi^j^s initiated ir< FY 1976 were' 
expahderl with tKe addi tioh pf^ten disl^acts to the ^approximately thirty- 

»two that used the $;/stem previously.<^ ; Workshops for local district per- 
sonnel were increased^ so as .to provide more assistance. Appendix SEA-25 
provides, -information on program bu'dg^iing design and, pilot implementation 
activities conducted during FY 1976. . / 



5. Ass.istance to Local Education Agencies 

One objective was established for this area: 

• Throughout FY 1977 the New Jersey SEA will provide LEAs ' 
with direct consultative and technical\ervices as 
required to deliver a T&E system as evidenced by a 
report to be submitted to the Commissioner (Annual Pro- 
gram Plan, p. 86). ' 

Documentation 

Several sets of activities are addressed to the LEA a^istance objec- 
tive. These. assistance activities are: 1) school facility j^lannlng; 
2) certification and accreditation; 3) grantsmanship; and, 4) EIC and. 
County Office/Services. , . - 

In addition to a major emphasis on providing assistance to LEAs 
within the context of T&E, the Department also provided services to dis- 
tricts in teacher certification and facilities planning.. Facilities 
planning services were provided to all local school districts to ensure 
the provision of suitable educational facilities. New school site^elec- 
tion, proje&ting long-range capital needs, and utilising healthful and 
safe temporary and permanent facilities were some of the major services 

w ■ 

of the Bureau of Facility Planning Services (SEA-26). 

The'major activities conducted by the certification unit during 
FY 1977 were: 

1) coordination of college and university teacher education 
2' program approvals (SEA-27) 

2) monitoring of the implementation of new certification rules 



nd regulations in college and university teacher education 
programs, and in the public school districts (SEA-28) 



3) certification of teacherOnd other professional educators 
(SEA-29)^7 • 
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During FY 1977, the Bureau of Grants management published a Directory 
of Federal Programs (SEA-30). In addition. Bureau staTf ran eight 
workshops throughout;,FY 1977 for local district personnel on identifying 
federal grant resources and applying for federal funds (SEA-31).^ The 
workshops were attended by over two hundred local educators (SEA-24). 

EIC and County Office services to LEAs have been focused primarily 
^on support to the T&E process. In-service training 'sessions have been ^ 
conducted for teachers and administrators. Retrieval of research and 
practice information is available to all local educators. . Several seminars 
and workshops have ^een conducted to explain various aspects of T&E 
implementation. Training packages were developed in assessment procedures, 
objectiveyindicatQjb^^rocedure^ planning/management training systems. 

County Office serviceiS^ focused primarily on assisting LEAs In the 



school approval process component of T&E (SEA-5) 
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C. ASSESSMENT OF THE PROCESS ^ . 

Documentation resulting from a reviJfof materials, of self-assessment 
reports, and from interviews indicates that all activities addressing the 
six stated objectives generally were undertaken as projected. As in 
FY 1976, the Department exceeded projected activities and services 
specified in tf^ Annual Program Plan. Several of the ktivities were 
continuations of ones , in-itiated \^ FY 1976. In almost every case of a 
continuation activity, an expansion in (quantity or quality of services 
appears to have been realized'. Major new or expanded activities in 
FY 1977 include: 1) the full implementation of the County Offices arid the 
EICs in supporting the development of T&E processes in local school dis- 
tricts; and, 2) the implementation of'^he Operational Planning System. 
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•As was the case" in FY 1976, "a small nlimber of activities "appear tq 
on-going, standard ofJ'erating* procedures and not related , to the short-, 
term development of new programs. Such acti^vities an* services as teacher 
certification, facility planning, auditing, accounting, and Interact 
appear to be well established and ful ly operational . Some also are periph- 
eral to the T&E^'theme" of the Annual Program Plan'. Since^the major 
purpose of the Title IV Progr^ is to support the development of new 
initiatives- in SEAs, these activities may be ready to be transferred to 

^ ^ • „ .... 

the State budget, allowing for the development of new activities to be 
initiated. ) 



\). ASSESSMENT of' 0UTc6mES AND IMPACT 

In addition to being ab.le to cite immediate outcomes of activities. 
Department staff were able to offer some information on the impatet of. 
some of the activities and services provided. i This assessment. Informa- 
tion responds to a recoimend^tion made in thq/FY i976 report"^ regarding 
the development of proxitnat^ i||^tors of jiripact. While ^there i$, still 
some progress that needs to b^We in. this area , FY 1977 dat^' repr^esents 
an improvement over that collected in FY 1976. Some of this increa/ed 
attention, to outcomes and impact, is attributable to t[je self-assessment 
form used to gather preliminary data for the evaluation of the Program. ' 

Several notable accomplishments were rea1iz6d-M'n the Stren^hening 
SEAs Program in, FY 1977. A brief discussion of these follows. 

The intermediate unit structure was fully developed during FY 1977 
and is providing an extensive amount of' services to local school districts 

^statewide Evaluation of E.S.E.A. Title IV i n 1^ Jersey^^ for 
Year 1976 , Education and Public Affairs, September 30, 1976. " 
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in t^he development 6f TiE activities. .Given the magnitude of • the qhange 

that T&E requires In the .management of education at the local level , it 
mt 

Is unlikely that such changes could take -place without extensive support 
from the CoSnty Offices and the 'EICs. ' ' ' 

The scope and quality of services available appear to be excellent 
and feedback fr-pm loqal district personnel is 'positive. Giv^n,that T&E 
places great demand^gp local admihistrators , the frequent contacts 
between intermedi'ate unit staff and local staff place both parties in 'a 
collaborative role.in ihiplementing change. " ' (/ ' 

The role differentiation between the County Offices and the EICs 
with respect to T&E is not clear. The regulatoj^y vs. .service distinction 
which was intended is not apparent jn the description of role's provided 
by each (SEA-1). In addition, the roles and functions of the, EICs with 

» » * ■ 

respect to service relationships with LEAs are not well defined. At 
present, no description is available of rationalie and relationships vis- 
a-vis the Department or with each other. The degree to which all EICs 
are to be similar or unique is left undefined. Thes^ variables are 
likely to be important in the future development of the EICs. 

An exemplary adtivity of the EICs is the development of a formal 
evaluation system for keeping managers' at the ^IC and the Department" 
informed on the, responsiveness of EICs to LEA needs and of the impact of 
EIC services.. It would appear^ however, that t.he development of such an 
•evaluation system shou-ld follow the development of a rationale and role 
delineation for the EICs in the State's education system. 

Ihe Regional Needs Inventory is an important sourcev,4Df information 
for defi)^^ng' the service delivery system of the EICs. The Inventory 



'• ^ documents well the general' and' specific needs of tEA's." Its 'existence as 
an activity puts districts on notice that the Department and the EICs are 
making a concerted effort to^provide responsive servi^ces. Since it raises 
; e)^pectat1ahs;^tl\e EICs must be ready to,respond to the LEAs needs. . Docu- 
mentation' of EIC actiyitie^'indlcatfts.th'a^^ respqnse is/taking place. 
^ Progress in the design and impleiT1entatlon,/bf th^,^^^^^^ Planning 
,;Sy&tpm was substantial during. lFY i977/^In FY 1^76; the basicvdesidn was 
;_.cotnp^leted but ijTiplerpei^tati on had only beerL* started in the Department. 
The inclusion 'of the bounty Ojifice^ and the ElC^ill make^it'Vossible 
ta-tie. the Department and the intermediate units togel^her .more closely ' 
: in terms of'^^T&E ffelated objectives. One danger of s^-cpmplex a process 
IS that it may become a burden to Department and int^r^iiediate unit staff. 
In ord^r'!to be Tisef ul , the System' must be^ able 'to prDvide"" useful informa- 
tion for decision makers' at all levels without requiring an inordinant * > 




(amount .of time fm/^input 



At tl^s point, tjJ^ro^siJo^ outcome of the OPS activity is that an 
operational) plan has^been prorfuced for-:FY 1977. No formal assessment has 
•been lindertaken to determine whether the purposes of the OPS and its 
^ reporting Systems are be.iTig met. Some questions which may be appropriate 

are: ' ^ • ' 

are identified through the monthly'^ogress 



T^for such an assessmi 
1) What p 




reports? 

2) What decisions are rtade as a result of the monthly ^ ♦ 

* ? ■ . '-..,./ ^ . 

progres4^ reports? 

3) How, specif ical ly^ has two-way communication^ been enhanced 
between the various levels of organization? 
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4), {jiow are the monthly progress . ^reports used in staff 
meetings? 

Th& Interact articles and Ihe newspaper itself are an exemplary response 
to the objective for dissemination. The timeliness of the articles h|felpS 
to keep the educational and lay communities up to date on T&E. Circiilation"" 

■ a 

was 30,000 in FY 1977, an increase of 4,000 over. that. in FY 1976. 

The fact that Interact represents a one-stop information source far^ 
educator and public information is a significant outcome in Itself. , In 
many SEAs, the number of individual publications which are distributed to 
educators and other groups is excessive. Fragmentation, duplication, and 
miscommunication often result. The development of. Interact has eliminated 
a substantial amount of such fragmentation and^upl ication, Given that 
the newspaper ha^ received three national awards, it is possible to say 
that Interact as a one-stop comnunication y.ehicle is much mare than just^ 

. ■ ^ . ' ' i > 

a cost savings device. 

' .. . ^ 
Outcome and impact information regarding Interact are not collected 



forma llyf\ That communication is taking\lace (a primary outcome of the 
newspapeH is attested to by the letters t\ the Editor, rqjquests for 



information from educator? and other persons arid informal feedback ^om 
LEA administrators. It .is used as an oriffotation and training tool on 
T&E by Jocal school boards and oth'er education agencies. 

' As in FY 1976, feedback i/iechanisms and assessment information Systems 
reig^^ ad hoc and informal. [Two-way communi(^tion usually is a serendipi- 
\ tous by-product of ^ a m\ss ^distribution n^wsparper. Moreover, mass comtnunica- 
tions do not .allow for tWc,ft£^ng specif i-e^oups (e.g:, superintendents, 
teacher^, and parents with specific information. Some ^ jgteract articles 
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are addressed to specif'fc gro'ups (citizens, PTA member's}' but no information . 
is' available concerning how many of those persons received .ahd>fead the 
particular article, , . • r ' i . * 

While there has been some effort to develop mechanisms' for determin- 
ing^ whether iritended outcomes are being realized and whet|i^r these out- 
comes are having any impact on education, such efforts, 1 n most/caseS , 
appear to be inadequate to the magnitude of the activities being implemented,. 
An evaluation, design for the EICs will be ah exception to this general iza- ♦ 
tion. Indicators of intended outcomes and impact have been formulated 
and measures are being 'deve^l oped to provide data |n those indicators, ^ . ^ 
Few, of the other major strengthening SEA efforts l^ve this capability. * L*' 

As was the case uj^^F^J^^ Strengffiehi ng SEA Program was 

marked by a high degree. of coherence and purposeful ness. Also, in seeking 
to "institutionalize" activities and services initiated with Title IV 
funds, twenty-seven positions, suflported previously ^y over $500,000 of 
Title 1)1 funds, were switched to State funding during FY 1977.- The quality ^ 
of many of the activities undertaken . is high' and'several of the projects 
(e.g., OPS, program, budgeting, EIC evaluation, T&E delivery system, and 
gran.tsmanship training) should be disseiiiinated as modeV practices to 
ottjer SEAs. * . ' '' 



t. IMPLICATIONS FOR FUTURE PLANNING 

The FY 197^ evaly^tion report^ made five recommendations regarding 
>thea^/e1opment of the Prog^^^^o of them continue to'^be relevant as 
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necommendatlons for the FY 1977 Strengthening SEA Program and are updated 
and repeated* for this Report. , ' . , 

1) . Measuring the outcomes and Impact of Strengthening SEA activities 
is impeded by the lack of measurable and proximate indicators of achieve- 
ment. Many of the activities in the^.Annual Program Plan are stated in - 
global arid vague language. Specifications in operational terms are seldom 
available. Such specifications would facilitate the development of fdrrria- 
tive and summative evaluation designs whi.ch, when implemented, could 
become part of the on-going administration of the activity. 

2) As in FY 1 57 -6 , .tlig Department relied heavily on Interact for 

its communications regarding T&E. While Interact is a high qual i ty/ o,ne- 
way coniiriuni cations mechanjsm, formal feedback mechanisms should be employed 
The Department should consider the use of multiple methods for. ascertaining 
reader response to the paper,. particularly to those articles dealing with 
T&E. ^ "TQwn .Meeting JI" represents an excellent model for .moving in that 
direction. ^ - 

Other recommendations for the continued development and growth of 
"the Program are: 

3) .An effort shouTd be made to clarify the roles and responsibilities 
of the EICs vis-a-vis the County Offices, Available descriptive material 
does not accomplish this. Also, some attention should ^De given to helping 
the ElCs establish a clear mission statement which addressees such issues 

as their relationships wi^h the Department and with the LEAs and the degree 
to which they are to offer similar services as opposed to "unique" services 
addressed to regional needs. The EICs represent a major organizational 



innovation, thus requiring clarity of purpose "and role for effective 
Implementation. / > \ . 

4) Because T&E 1s a -major, Innovation which Is receiving much 
.national attention and because Title IV, pa^p^tlcuUrly the Strengthening 
SEAs Program, is so integrated wtth it, the Department should .consider 
the development b^f a broad case study of the design and 'implementation 
process. This information woul'd be most useful as a summary of the 
specific Information being collected in the State and would provide a 
valuable service to other SEAs engaged in^similar activities. The T&E 
effoVt in New Jersgy has several features which are exemplary and worthy 
af dissemination nationally. 



F. ALLOCATION OF TITLE IV FtlfjDS ' 

The table on the following page illustrates the allocation of the 

IV-C funds which supported the Program for Strengthening Leadership 

Resources of State Educatibn Agencies. Estimated and actual expenditures, 

as provided by SEA program staff, are given for the activities discussed 

" . ■ ■ ■ ' ■ ■ ■ ^ . 

in this J?eport. This Report, however, is a^ program audit, not a financial 

audit. ' ■ , 



\ 



r 



r , v-20 
'93 



TABL^ 



_\. 



ALLOCATION OF TjtLE IV FUNDS TO 
STRENGTHENING SEA ACTIVITIES 
-FY 1977 



Activity 

Planning and Evaluation 

Educational Data Irifo Sys, 

Di$)iemi nation 

idlicational financing 

Assistance to LEAs 

/ Subtotal 

Equipmeijjt., Material s , 
and Support 



TOTAL 



Estimated 1 . 
Expenjlitures 



Actual 2- 
VExpenditures 



Staf/f ( 
2 

• 2 
B"4 



Funds ' • 
$ 394,144 
,135,320 
98,704 
380,500 
365,105 
U373,773 




$1,171,773 



Staff 
24 
12 

X 

31 

'84 



Fundfs 




$1,696,829 



^AsrproposedX(i Annual Program Plan 



■Not Based on Audit Data 
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TITLED IV MANAGEMENT ' 



title and DesGription 



' ^RT . Title IV Program . New Jersey Department of Edueation., 
May, 1976. / ■ \ ,/ , ' , / ^ ; ■ V. ^ 

The PERT chart and activity dictionary present timeViti^s ' 
for major activitfes. Responsible s.taff are' also, identified. 

Grant Award Routing S Tip . ' New Jersey Department 'of Education 
June, 1977. - - ' ' l ■ 

■' ■ ■ . ^ ^ ' l ■ ' . ■ f ' 

•Grant award, forms for approving Title IV-C grants " . ,■ 

Sample Correspondence , 

Copies of correspondence' from Title JV Offite illustrating*'. • 

variety of^communications sent out i , . 

' • ■ ' . ■ . ■ ' ■ ' ■ p, ' ' ']. ' 

Re6rqanization;Pl an for Title IV.-C. ,New Jersey Department • 
of Education, 097/6 ■ . < 'A v ■ 

Plan describes roles and responsibilities of Department^ 
units in carrying out Title IV aqtiV/i ti.es. ,' i / ,/ 

Agendas and Minutes , State Title £V Advisory Council , ' ^/ ; 
New Jersey Department of ■Education,. 1976^77. V 

- , ■ ' ■■/ ' ^' ,■■ ' 

Agendas and minutes of all SAC/meetyinqs conducted durinq 
FY 1977 ■ / . * , ' > ■ 



Presentation to National Title «it Conference , Washi ngton , 
D. C. February 1977. ~7 ^ ' 

■ ■ ' ■ ^ ' ■ ' / 
Sta.te Title IV Coordinat9f's speech on the Title IV 
Program in New " 




TITLE IV-B. LIBRARrES V\ND LEARNING ^RESOURCES 



Titl^ iand Description ^ • i^- 



Calculation of Local School pistr*ict"Anotment for.P.L. 
93-380 , TiTle IV. Part B . H^Vj J^rsm Department. of 
Education, DivT?i on of ildministratlon' and Finance, 1976., 

I, ■ ; ^ _ i , %, ''' < 

Table provides inforrnatiorf^'tfn the ,a1 lotTO Title IV- 
B. funds by county. Lowest and higHest aHotment per 
student and lowest and h^lghest total aV1otments,^.are 
provided ror each county. , t 



Report of fifllUnqs of Qn-Site Evaluations of a^ Sample , 
of Title rV-B Proj-ects . IS.upplement ttf^ CvlTuation of 
TTtle IV in NeW Jersey, Educational Consulting Services, 

■•' ■ . ■ ■ ■ '-''^ 

This suppleipentaif^ ireMH^^pr^^ a summa^^of find- 
ings pf the oh-^site interviews, conducted in' a sample 
of thirty-eight districts. The interview schedule 
used .to colleqt da^ta is *inc1uded as an atppendix^to the 
report. . " "i ; / ' ■ 

Project Appl i ca t i on '^ ^l^' ti tl e IV-B . - New Jersey-^ 
Department of E^i^qat ion, 1976-77. ;^ 

ApplicatipW has eight sections dealing with sucK ^ 
informaticm requiremfe»its = as basic data, non-^ 
school tnw4^mfenti and ma-intehance *of effort. . 

Annual Program^ pl^ati J;or thfi^^ Consolidation of Libraries " 
and Learning Resources^, Educational^ Innovation and 
Support > Title LV .of the Elementary and Secondary 
Education Act of i965 > as Amended , Added by Section 
WrE^.,;^^380.~^I .4. 2: CrUerTaTor Distributi ( 
oTFundsyPart B", FY 1977. 

The Program RTap describes three formulas develof^d 
md applied to^/ifneet the requirements! of the- Act 
regarding the distribution of Part B funds. The. 
formulas cortcerh distribution based 'on the number 
of students, the LEA per pupil expenditure, and 
p^centage of children from families receiving AFDC 
funds. ^ 
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IVt-B-5 Title IV-B AVIocation for Essex County , FY77. 

Nevy Jersey Department of Education, D1vi.sTbn of 
' ^ / Administration gW' Finance, ,1976. / 

Table provides^ information on expenditures equaliza- 
tTon value, tax rate, percent AFDC, enrpllmenti and 
; , allotments for sohool districts in Essex County. 

IV-B-6 ^ Sample A1 lotment. Table . New Jersey Department of 

[ . . . Education, Division of Administration and Finance, 1976. 

A computer print-out' from tKe State Department of' 
Bducatiom notified' the LEA €f the amount of per-pupil 
fonding. This sample allotment table shows factors 
producing allotment calculations afld the allotment ( 
per^nrollment for schoai/s in the Newark district, 

IV-B-7 Letters oT^T'R^iiTri cation / New Jersey Department of 

Education. . - . 

Letters of notification of available funds unrfelt ESEA 
Title IV were sent by both -the Commissioner and the 
State Title IV Coordinator. An additional lejtter 
regarding reppening of the Title IV-B applic/tion ' 
period was sent by the Title- IV-B Coordinatjfr in 
April, 1977. 

IV-B-8 Guidelines for ESEA Title TV, P^f-t ^ New- Jersey 

Department of Education,^ 1976-77. * ' 

■ - ' - - ■ ' • > . '. < . 

The guidelines provide detailed information relating 
to{ st;andards for determining the eligibility of ^ 
Ti^iaJV-B items in: 1) school library resources, , 
textbooks, and other .instructional materials; 
2) Jnstructiona], equipment and minor remodeling; 

^ and, 3) guidance and coufiselirig, services,' testing 

* materi^'als and services. 



J 




IV-B-9 gSEA Title IV, Pfrt C — Continuation Grants , ^ 

Suppl ementatton^^^DflararTt Awards and Extension of- 
Grant Peridds .: U.S. Office of Education, 1977. . 

■ y ' ■ " Page 3' of this memorandum^ explains the e)^ceptional 

situation whereby applications for IV-B funds ma> 
be received at more than one time during the fiscal 

/ • ^ year. : 
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Orlentatibn Sessions for Local School Districts 
Applying for T>it1e IV Funds Available under Parts * 
B and C, New Jerse7"Departnient' of Educatidn, 1976.^ 

This memorandum advises all local district personnel 
of the times, dates, and locations for orientation 
Sessions regarding application for Title IV fun^s. 



ESEA, Title IV-B , Maintenance of Effort ^ Summary , 
New Jersey Department of Education, 1977. 

^ This memorandum shows expellHitures by county for . 
FY76 and for FY77. Total expenditures for FY76''ttere 
$p , 302,^41 and for FY77 were ^$98,550^3, 

Exemplary Title l\v-B Projects . New Jersey 
Department of Education, December 3, 1976. ' 

'Memorandum describing selection process for 
identifying five exemplary Title IV-B. projects.' 

Discussion Guide : Evaluation and Reporting . U. S. 
Office of Educatfon, February ,"T977, ; 

/ • ^ ' ' ■ 

/This; guide pravides information regarding evaluation 

and reporting requirements and suggests options .for 
contpliance. 

ESEA Title IV : Maintenanc^ -of Effort Requirements , 
U.S. Office of Education, AprTl 20, 1977. 

rThis memorandum explains the hew maintenance of effort 
requirements which are extended to all non-public 
schools. 
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IV-C, EDUCATIONAL INNOVATION 



ritle and Description 




Annual Program Plan . New Jei^seylDepartraeht of Education, 
1976. ^ \ ^ 

The. pTan for Title IV-C, Educational Innovation summar1zes»^ 
the educational goals for the State of Mew Jersey, provides 
achievement data, lists educational priorities for the 
State, and describes the processes used In admlnisferfng 
jthe Program. . ^ '■■}■' 

Guidelines for ESEA- , Tltle ^fv, Part C> New Jersey Depart- - 
ment of Education, 1976-77. - " 



|The guidelines provide Information, direfctions, and forms 
jifor applying under ESEA, Title IV-C. - 



■ / 



Program Announcement , ESEA , Tttle IV, /New Jersey Depart- 
ment of Eduea^tion, 1976. . 

Notifications of avall^le funds under ESEA, title IV 
were sent by both thaS Commissioner and the State. Title 
IV Coordinator to aVl LEA^. The notifications contained 
information on a special Request for Proposals in the 
area of Math. . . - ' ■ ^ 



Program Announcement , ESEA , Title I,V. New-Jersey 
ment of -E^ducation, 1977. 



Dfi^rt- 



'Notifl cation of additional available fu>ids under ESEA, 
Title IV was sent' to all loca> districts in the Spring 
of 1977, The nottfication contained iofornfiation on a : 
Request for Proposals for supplemental center services 
on a multi-district basis./ 

Table of Newly Selected Projects and Priorities Addressed . 
New Jersey Department of Education, \^77' 



Technical Review Forms for Development- and Validation 
Proposals' . New Jersey Department of ilducation, 1976-77. 



These forms are used^by the review teams in rating^the 
, clarity and consistency of 4^aft proposgils for deyelof)- 
y m^nt projectjS and for validating established projects- 
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IV-C-7' . # Reviewers of DeveVopmen.t ar>d RFP Applications ^ 

^ Brief resumes showing ihe qualifications of persons • 
^^A-^ selected to review and rate IV^C^develbpment an^ RFP ' i 

^ V applitjations. ^ ' / ^ V . . . . 

-IV-C*8 ' ^ ESEA , Title IV-C Selectidri Process Review Fm-mg , Stage I, ' 

New Jersey Department of Education, ,1976. 

Forms used for review.and rating* of threfe types of IV-C 
^ applications: development, validation, and RFP;' ; . 




Package of Materials for Stage TI Iteviv^wers^ NefW Jersey ' 
Department of Educa<y€ivr 1976, , ; 

Iru:ludes description of the Stagff II process and Criteria 
' fo\^approving projects ' / - ■ 

IV-C-IO : Statistical Informatloh ; First Year-Project^* Only . 

New Jersey Department of .Educationi 1976. 

Forms for shojwin^ pupil membership by grade and 
, specific student population to be servdd, by public 

and nonVpublic schools - t !\ 



IV-C-ll Sample Correspondence . 

Samples, of correspondence betw^n public and private. 
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non-profit schools concernirig participation in Title. IV-C 
projects 



lV-C-12 Participation of Non-Public , Prii^ate Schools ^ in ESEA , 

\ IV-C during FY77 , New Jersey Departmertt of Education, July 22, ^ 

T977. ~. \ ^ . ' , 

' This meinQ. to th6 State Title IV-C Coordinator -provides . , . 
information on the number of IV-^C development applications 
submitted which^ contained documentation regarding efforts c 
to involve nonVpublic schools .in fhe planning of proposals. 

J ' r ■ ' ^ . • ■ ' • 

■ ' i " ■ . , » . ■ ■ - . .. ^ 

IV-C-13 Manual for . On*' Site ^ Evaluations , New Jersey. Department 

. of Education, 1977. . . ^ , . , 

A handbook for evaluation .consul tants conducting Title ; 
iV-C on-'Site evaluations. - 
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Project Evaluation Report . MeiTOersey Department of 
Education, 1977. , '/ 

Forms, to accompany Manual for Qn-Site Evaluations 



Op-site Evaluation Progress Report i New Jer^^y Department 
. of Educat16n, April 25, 1977. 

. ■ . . ' ■■ ■ , - . / 

Report outlines progress in conducting on-site evaluations 
of IV-C projects. / I ' 

' Sample End-of-Year Reports , ^ 

Reports^ fr'Om Manasqjjan and Highland Park describe/process 
and product outcomes cTf previpcs year's developme(itaT 
project. v ' ' ' ^ 

■ ■ ' ' ... \ .. , 

Project Visitatio" Log . New Jersey Department of Educa- \ 
ti on.. 1977. ' " ' 

Samples of the logs used for monitoring p^roj^cts and 
documenting problems and remedial step^ taken- ^ 

Criteria f or Eyaluatioil DesignV New Jersey Department 
-of Education, 1977. . ^ 

. Gufdelines for districts in constructing an evaluation 
design for a Title IV-C project. ^ . 

■ ' ' . ■ . I It" ' , ■ * ■ r-* 

A Mathagement Jraining Institute: for Managers of Change. 
Gapla Asspciatesv Inc. , Rochelle Park, New Jersey, 1976. 

Materials for a management training program for both 
f)rbject directors and SEA process consultants who 
monitor IV-C projects, g 



Educat Zonal Development Conference . New Jersey Department 



fL : 

tional ■ 
of Edu^;ation, January, 1977. 

The Agenda outlines the ^statewide Title IV Conference 
meant^o provid[afeWorJcshops on educational change and 
development^and to honor exemplary IV- B' and IV-C projects. 



l.V-C-2.1 ■ ' Allocation of .Title TV- c\ Funds to Development find ■ • 

. . DUsemlnition 7CTviITe7 |: 7?^ ..v--'^-^. 

' This memorandum, shows the amounts (in' db^laris and 

percentages) allocated to 'development and dts^semina-. . 
• • ' :" tion activities during FY77j ' . , ' 

' «' , ■ • • . .. , ■ ' 

. ■ ' ■ ' ■ ' ■ . \ ■ . • .. ' . _ .■ . - 

IV-C-22- ' Distribution of ESEA Title IV-Cf^ Projects by^ 'Type of.. ' 

V District . ^' • > . ■ _ ' 

.Memorandum indicating* t^at lO^of New »JerSjjy's 28 urban 
districts received funding ^rfnder Title IV-C in FY 1977. 
The fourteen projects in the tert d1stricts<received 

. appfjoximately 501 of. FY 1977 Title IV^C funds. ' 

IV-C-23 . . * Report dnA Urba'n Involyement ^nder ESIA ^ TUI.e IV-C > 

New Jersey De pa rt me n t of Ed u ca 1 1 o n , 0 f f i t eT'bf ^ 
' Program. Develbpment* Undated. <- ' ^ 

.Title ly-C projects addrjessed to urba^n n^^^ Funding., 
level^ are given. ^ 

IV-C-24 Interim Report on the ESEA , Title iv~C ' Dissemination 

f>rograrn for 1^76-77 . Ne^ Jerse/ Department of ■ Education, 



y 



May. , 

• * . . ' ., ' '.■»■■,■ 

.Summaries of data are^ provided on the Project Center's • 
dissemination activities for the period; Jyly to < , ' 
December, 1976., A description Is provided of each 
project. Include^d are references to manual^ written - : 
or edi ted » feature articles written for Interact , 
jiailirigs, presantatioris, parttcidation in conferences, 
and technica^^assj^tance given. Costs' of dissemination 
activities are also provided. 



IV-C-25 " Educational Programs That Work. New Jersey Department ^ 

• of Education, January, 1977. 

' A catalog of vdfemonstration sites ^ • , 

/ educational prbgjia^ disseminated through the , 
>New Jersey ESEA,MTtle' IV-C program. • , - 

IV^C-26 ; Status Report^ on ESEA , Title . IV Development Projects , ^ 

' ; ' . New- Jersey^ Defpartment of Education , 1977 . 

\ This, table shows the number of projects completing ' r 
development, validatron, and termination before completion 
\ ' / > ^ ^ ^ for FY77. v. * ' , ^ 

• ^ • ' ■ ■ ' ^ — vi-8 \ ; 



'IV-C-21 Dissemination Stattis Report . New Jersey Department 

• '' * - of, Ediiieation . 1977 ."' ' . ^ - • 

, . ' This table provides; information on. the dissemination 

. -activi ties of the thirty projects 'funded un^er ESEA. 

V- V .. ' Title IV-C. The project, ^^ts originating district, 

' data validation and the -type of dissemination/adoption 

^■'<f'^'^^^'L^r. V : \ ^ model uaed a : . , \ 

■ ■ ■ , V . > , v J)uHiia^ ^^ ^ De cember 31, 197 6/ 

V T^^?^^^^^^^^ this tab Tfevshw^ the number of adoptions 

i^:-''';;' vyithiff N^w Jers^^^ i and the . number of 

$[}rr}k^ in- and out of state. 

29 * List: - 0^ LacaH;ions :a^ Which^ Information ' on Successfu l 
- v Proigi^am^ is Kept , , ^ - ..f 



' ,--•3*", 



Twenty-seven locations- at which information on successful 
New Jersey.; IV.-C projects Is kept as a ^ of Increasing 
aidoption. 

IV-C-30 Project jQi]^^ 

Table, showiiig by. projec.t,^^ number of adopting 
districts and the number of ^^ teachers, 
administrators, and community persons impacted. 

IV-C-31 Development ProjeH Ratings . 

>TabVe, showing by project (log numbers), the ratings 
awarded by, on-site \eva1uators for innovativeness, 
effort, costs, and V>^Portabi1ity. 

IV-C-32 "Goals of the State Education Agency Development Program,'* 

Speech by Commissioner Fred G. Burke, Educational Develop- 
, . ment Conference, January, 1977. 

, . ■ ■ ' ■•, -f 

Dr. Burke reviews successes and limitations of the 
"lighthouse" development concept and suggests a new 
4 model for developing arid disseminating educational 

* . innovations. 
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PROGRAM FOR 'STRENGTHENiNG LEADERSHIP RESOURCES OF 
.ST;\TE EDUCATION AGENCIES 



Title and Descriptlo 



t- 



SelfrAssessmeryT RqiJorts. 



Sel^-assessment repprts on» activities , outcomes and 
impacts were preparecj by SEA staff involved in 
Strengthening SEA Program activities, 'feports are 
available .for each of Uhe five areaa in the Annual 
Program Plan. ^ --^ 

Ojjerational P1an > Office of Planning, Research and 
and Program Developfiient, New Jersey^epartment of 
Education, 1976. 

The Plan lists primary and secondary objectives and 
activities for the planning unit. 

Policy Research Papers . Policy Researph Program, New 
Jersey Department of Education, 1976-77. 

A collection of papers • deal ing with policy analysis 
and recommendations in urban, career, and comprehensive 
arts education r 



Early Childhood Planning Project . New Jersey Depart- 
ment of Education, FY 1977. 

Descriptions of policy research papers produced for 
the Early Childhood Planning Project. 



County Office Operational Plan , New Jersey Department 
of Education, 19^77. 

Plan describes objectives and activities for Union 
County. An organizational chart and time line is 
Included. 
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1976 New Jersey jjegional Needs Inventory , New Jersey 
Department of Ecfucafvpn, March, 1977. 

Rlp4|^t summarises resuVlts of a survey of LEA service 
needs to which the EIC5 are to respond. ^ 




" Planning besign\ New Jersey Department 



^on, March, 



1977 



Materf3rt3 describe the ttroajd planning design for apply- 
ing the T&E model to the SEtV. Components and procedures 
are described, as is a monthly reporting system. 



Standard Operating Procedures for Collecting Data From 
Local Educati on Agenci es . New Jersey Department of 
Education, April, 1976- 

Procedures to pe used in data collection activities 
administered by the Department of Education are cjescribed 
An information communication system is described/ step- 
by-step procedures are presented, and functions and roles 
of data collection participants are delineated.* - 



Department Data Collection Instrument Progress Report . 
New Jersey Pepartrnent of Education, June, 1976. 

^his.dt^aft document presents the results of a review 
of data collection instruments used by the New Jersey 
Department of Education. The process of instrument 
review and consolidation is described. A list of 
approji/lfsid instruments for the 1976-77 school year is 
appentJed to the report. 



Data Dictionary . New Jersey Department of Education, 
June, 1977. 

The data dictionary serves as a guide and reference 
tool for all data collection for the New Jersey 
Department of Education. 



Statistical Reports , New Jersey Department of Educa- 
tion, 1976-777 

Sample of statistical information developed by the 
New Jersey Department of Education. 
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Interact . Volume 3, No. ^, September, 1971^ p. .1 and; - 
pp. 10rl3. • -V ^ ^ ' 

Articleseriti tied ^''Professor Studies Pol itical Rea^tl-ions 
to T&E Court Rule" ^ind "T&E: Sehoo]^ Improvement in ;^ 
New Jersey. - * * , ^ -^\^ 

Interact . ^Volume s, No. 3, October, 1976,' p. 10. 

"'ERIC has biblioQF.aphy on New Jersey's T&E" desfribes . 
nine journal' articles and six dpcuments on T&E. 



InferactJ Volume^ 3, No. 4, November, 1976, pp.4 and 9. 

. ' • ■ ■ ; ■ . 

Arti-cles entitled "Join in T&EJ procedures Says State 
PTA to Public" and "Here's How One N.J. School ^istricf? 
is Complying with the New T&E Law." 



Interact . Volume 3, No. .5, December, .1976, p. 3. 

"Questions and Answers on Thorough and Efficient'' 
explains T&E and terminology. 



lYiteract . Volume 3, No^ 6, January , 1977, i^; 7. 

"State PTA Lists T&E Procedures for Local Organiza- 
tions to Follow" presents eight steps for local PTA 
involvement. 



Interact . Volume 3, No. 7, February, 1977, pp. 2 
and 20. 

"T&E: The Law and the Citizen" helps citizens under- 
stand the J&E process and the benefits it can produce. 
"Town Meeting 11" announces the second meeting on T&E 
broadcast to the public via television. 



Interact . Volume 3, No; 8, March, 1977, p. 3 and 
pp. 8-9. 

"Minimum Standards Questions Answered" and "The EICs." 
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.Interact. Volume 3, No. 9, April, 1977. p. 3: ° 

In "T&E-^?is Bright Future According to Dr. Efurke," the 

Commissi^her, dtes professional and public support for 

T&.E. ... . . . . ' 

- ■ ' • - _ . . • \ 

Interact , Volume^ S^U^o. 10, May/June, 1^\7.- 

Entire speQial issue devoted to T&E. MjRjor articles 
on T&E priorities, T&E calendar for 1977-78, minimum 
standards test resia1ts,\ and needs assessment. v • 



Sample News Releases . New Jersey Department of Educa- 
tion, 1976-77. 




Sample news rel^ses issued by the Department.^ 



Monthly Accounting Reports . New Jersey Department 
of Education, February 1, 1977. ^ 

Memorandum explaining the ei(ghteen monthly accounting 
reports, produced through the :new accounting /system. 



Interoffice Memoranda - Auditing Section . New Jersey 
Department of Education. ^ 

This collection of thirteen memoran^la outline the ' 
majar accomplishments of the auditing section during 
FY 1977. Major activities are reported for the areas' 
of auditing and evaluation, ESEA Inspections, account- 
ing andj^payron conversions, and technical assistance 
to locaT.school districts. 



Grants Management Activities J New Jersey Department 
of Education, May 25, 1^977. 

Memorandiim describing activities of Bureau of Grants 
Managemerit during FY 1977. Attachments corftain details 
of grant |nanagement activities. 

■ V ■ ■ ' ■ . 

Program Budgeting Publication a nd Materials. New Jersey 
Department of Education, 1976-77/ 

A collection of ,PPBS materials describing workshop 
agendas and publications for use in implementing 
program budgeting in New Jersey LEAs. 
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SEA>26 Memoranda' ; Bureau jdf Facilltj^ Planning Services , 

New Jersey Depaririient of Education, 1976-77 • V. 

^. ^ Samples of . memoranda sent to^LEAs' and* other'education 

officials regarding facility 'plannirtg.r ^ - ■ ^ 

SEA-27 . • Approved Coursesv New Jer^et^ Department of Education,- 
'March 17 i 1977- • U 0' ^ " v 

Memorandum illus trla ting t^e/natufe of approval 
activities for teacher education prpgrams.^ 

■ .■ ^- ■ ■• :/ ' ■ ■ ' ■ ■ ' ' 

SEA-28 Regulations and ,: Standards . /^ Certif icatiog . New > 

Jersey. Department of EducjatToti, 1976. ; [ ' 

Annual pub^icfation of ^^^S^sey pepartmeht pf Educar 
' • tion concerning regufationS and standards /or certifi- 

cation.- .• 1 ■ "." ; ■ 
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- ■ i ■ ■ , i « ' • . 

SEA- 29 Teachfiy\ Education and/ Academic Credentials, New. 

•Jersej^ Department of^/Educatio'n, 1977'.- 

A summary of authorl2atioln's issued between: ^uly 1, 1976, 
A and Marcti 31, 1977./ ' - 

. ■ ; \ - ■ ■ 

SEA-30, " A Directory of Fei^eral Programs .. -New Jersey Depart- 

ment of Education, September , .J976. 

This directory outlines federal programs which are 
administered by/ the New Jersey' Department, of Educa-' 
tion. The Directory emphasi zes those programs for 
whichi local edijcation .agencies lir^ e 
participation/ \ \ ' ^ . ^ 

SEA-'Sl Grantsmanship Training Seminar . Nev) Jersey Department 

of EducatioTY. 

■ -r • ' / : " ■ " ■ „ 

An agenda qiitlining topics covered at eight seminars 
J ' run on graritsmanship. 

/ ■ 



■I 




VI. 14 



noi V 



SECTION VII 
PERSONS •INTERVIEWED. 



Name 

■ - ■ . ' f 

. 1- Danljel Bevilaqua^ 

2. Stephen Blaustein 

! 

\ ■ , . ' I . 

3. Thomas Corcoran • 

4. Frank Fal'coni6ri 

5. Ranald LeSher 

6. Ffi chard Mills . 

7. Joseph ,^cogna 

8. Robert RusselV . 

9. Randolph Schaeffer 

10. Robert Swissler 



fitle ^ : . 

■ , ** ■ 

AssistpntToirector | - . 
'Bureau Wf^GrantsManagpfernent, 

Director^ / ( ' 

Program M^agement and Development 

State, Director , Evaluation 

Consultant 

Research, Planning and Evaluatioi^ 

'Evaluation Specialist 

Planning Associate 

State Director, Title IV 

Chief, Data Processing • j 

.Assistant Director 
Educational Plans and Supplemental 
'Centers 

Coordinator, Title IV- B 



115 



ERIC 



